Sep 04 22:06:43.016869 ip-10-0-139-255 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 04 22:06:43.016880 ip-10-0-139-255 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 04 22:06:43.016890 ip-10-0-139-255 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 04 22:06:43.017119 ip-10-0-139-255 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 04 22:06:53.191342 ip-10-0-139-255 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 04 22:06:53.191359 ip-10-0-139-255 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3ec3e805eb7645fe9a57e4835933ae39 --
Sep 04 22:08:46.088872 ip-10-0-139-255 systemd[1]: Starting Kubernetes Kubelet...
Sep 04 22:08:46.450434 ip-10-0-139-255 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 04 22:08:46.450434 ip-10-0-139-255 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 04 22:08:46.450434 ip-10-0-139-255 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 04 22:08:46.450434 ip-10-0-139-255 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 04 22:08:46.450434 ip-10-0-139-255 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 04 22:08:46.451353 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.451270    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 04 22:08:46.454806 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454791    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 22:08:46.454806 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454807    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454811    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454814    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454818    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454821    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454823    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454826    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454829    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454832    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454835    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454837    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454840    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454843    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454846    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454848    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454851    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454854    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454857    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454860    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454863    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 22:08:46.454868 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454865    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454868    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454872    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454876    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454880    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454883    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454886    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454889    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454892    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454894    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454897    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454899    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454902    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454905    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454908    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454910    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454913    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454916    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454918    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 22:08:46.455342 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454921    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454923    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454926    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454928    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454931    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454933    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454936    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454938    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454941    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454943    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454946    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454948    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454950    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454953    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454956    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454959    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454962    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454965    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454968    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454970    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 22:08:46.455805 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454973    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454976    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454978    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454981    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454983    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454986    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454988    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454992    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454995    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.454998    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455001    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455004    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455007    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455009    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455012    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455014    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455017    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455020    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455023    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455026    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 22:08:46.456294 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455028    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455032    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455035    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455037    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455040    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455043    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455045    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455050    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455053    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455055    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455058    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455061    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455063    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455066    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455068    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455071    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455073    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455076    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455079    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455806    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 22:08:46.456798 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455815    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455818    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455821    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455824    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455828    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455830    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455833    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455836    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455838    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455841    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455843    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455846    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455849    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455851    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455854    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455856    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455859    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455862    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455865    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 22:08:46.457322 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455868    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455871    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455875    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455879    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455882    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455885    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455888    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455890    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455893    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455895    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455898    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455900    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455903    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455906    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455908    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455911    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455913    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455915    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455918    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 22:08:46.457814 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455921    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455923    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455926    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455928    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455931    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455934    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455937    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455939    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455941    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455944    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455947    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455949    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455952    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455955    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455958    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455960    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455963    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455965    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455968    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455970    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 22:08:46.458284 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455973    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455976    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455978    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455980    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455983    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455985    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455988    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455990    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455993    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455995    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.455998    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456000    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456003    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456006    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456008    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456011    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456014    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456018    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456022    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 22:08:46.458781 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456026    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456028    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456032    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456035    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456037    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456040    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456043    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456045    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456048    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456050    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456053    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456056    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456058    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456061    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456064    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456066    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456068    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456071    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456073    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456076    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 22:08:46.459235 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456078    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456437    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456442    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456445    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456447    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456450    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456453    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456456    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456458    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456461    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456464    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456466    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456469    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456471    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456475    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456477    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456480    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456483    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456486    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 22:08:46.459728 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456488    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456491    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456494    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456497    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456499    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456502    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456505    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456507    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456510    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456512    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456515    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456517    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456522    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456524    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456527    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456530    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456532    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456535    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456537    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456541    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 22:08:46.460272 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456543    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456546    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456549    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456551    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456554    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456556    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456559    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456562    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456566    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456569    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456572    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456575    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456578    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456581    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456583    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456586    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456589    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456591    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456594    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456611    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 22:08:46.460793 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456616    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456620    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456624    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456626    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456630    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456640    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456643    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456647    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456649    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456652    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456654    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456657    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456660    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456663    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456667    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456669    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456672    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456674    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456678    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456682    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 22:08:46.461266 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456685    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456687    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456690    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456692    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456695    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456697    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456700    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456702    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456705    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456707    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456710    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456712    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456715    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456717    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456721    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456725    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456728    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456731    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456733    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 22:08:46.461761 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456736    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.456739    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456810    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456856    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456863    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456867    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456875    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456879    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456884    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456888    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456891    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456894    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456898    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456901    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456904    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456907    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456910    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456913    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456916    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456919    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456924    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456926    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456930    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456933    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 04 22:08:46.462249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456936    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456940    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456942    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456946    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456949    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456953    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456956    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456959    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456962    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456965    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456969    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456972    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456975    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456978    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456981    2564 flags.go:64] FLAG: --enable-server="true"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456985    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456989    2564 flags.go:64] FLAG: --event-burst="100"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456992    2564 flags.go:64] FLAG: --event-qps="50"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456995    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.456998    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457001    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457004    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457007    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457010    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457013    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 04 22:08:46.462844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457016    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457019    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457021    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457024    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457027    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457030    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457033    2564 flags.go:64] FLAG: --feature-gates=""
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457036    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457039    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457043    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457046    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457049    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457053    2564 flags.go:64] FLAG: --help="false"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457056    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457059    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457080    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457084    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457088    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457092    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457095    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457098    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457101    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457104    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 04 22:08:46.463447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457107    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457110    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457114    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457117    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457119    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457122    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457125    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457128    2564 flags.go:64] FLAG: --lock-file=""
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457131    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457134    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457137    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457142    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457146    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457148    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457151    2564 flags.go:64] FLAG: --logging-format="text"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457154    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457158    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457161    2564 flags.go:64] FLAG: --manifest-url=""
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457164    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457169    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457172    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457181    2564 flags.go:64] FLAG: --max-pods="110"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457184    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457187    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457190    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 04 22:08:46.464092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457193    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457196    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457199    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457202    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457209    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457212    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457215    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457218    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457222    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457226    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457229    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457232    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457235    2564 flags.go:64] FLAG: --port="10250"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457238    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457241    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-073d41d5108af5729"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457244    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457247    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457250    2564 flags.go:64] FLAG: --register-node="true"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457253    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457256    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457259    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457262    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457265    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457268    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457271    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 04 22:08:46.464730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457274    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457277    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457280    2564 flags.go:64] FLAG: --runonce="false"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457284    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457287    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457290    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457293    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457296    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457299    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457301    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457305    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457307    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457310    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457313    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457316    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457319    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457323    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457326    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457331    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457334    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457337    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457341    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457344    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457346    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457349    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 04 22:08:46.465321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457352    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457355    2564 flags.go:64] FLAG: --v="2"
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457359    2564 flags.go:64] FLAG: --version="false"
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457363    2564 flags.go:64] FLAG: --vmodule=""
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457366    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.457369    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457478    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457482    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457485    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457488    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457500    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457503    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457506    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457508    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457511    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457515    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457519    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457522    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457524    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457527    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457530    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 22:08:46.465975 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457534    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457537    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457539    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457542    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457545    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457548    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457550    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457553    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457555    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457558    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457561    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457563    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457566    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457569    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457571    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457574    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457577    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457579    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457582    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457585    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 22:08:46.466480 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457588    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457590    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457593    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457595    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457610    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457615    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457618    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457621    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457625    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457628    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457631    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457634    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457638    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457641    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457643    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457646    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457649    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457651    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 22:08:46.466989 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457654    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457657    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457659    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457662    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457664    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457667    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457669    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457672    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457675    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457678    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457680    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457683    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457685    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457688    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457691    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457693    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457696    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457698    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457701    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457703    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 22:08:46.467432 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457706    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457708    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457711    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457713    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457716    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457718    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457722    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457724    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457727    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457730    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457732    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457735    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457738    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457740    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457743    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457745    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457748    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457750    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457753    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457756    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 22:08:46.467936 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457758    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457761    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457764    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457766    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457769    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.457771    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.458433    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.465698    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.465711    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.465727    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.465733    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465803    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465808    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465811    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465814    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 22:08:46.468415 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465817    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465819    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465822    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465824    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465827    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465830    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465832    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465835    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465837    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465840    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465843    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465845    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465847    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465850    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465853    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465855    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465858    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465860    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465863    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465867    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 22:08:46.468840 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465870    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465873    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465876    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465880    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465883    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465892    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465896    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465898    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465901    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465904    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465907    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465909    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465912    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465914    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465917    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465920    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465922    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465925    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465927    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 22:08:46.469359 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465930    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465932    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465935    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465937    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465940    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465943    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465945    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465948    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465950    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465953    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465955    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465958    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465960    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465962    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465965    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465967    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465970    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465972    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465976    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 22:08:46.469842 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465987    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465991    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465993    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465996    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.465999    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466001    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466004    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466007    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466009    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466012    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466014    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466017    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466021    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466024    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466027    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466035    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466038    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466041    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466044    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466046    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 22:08:46.470309 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466049    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466051    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466054    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466056    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466059    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466061    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466064    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466066    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466069    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466071    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466074    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466077    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466079    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466087    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466090    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466093    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 22:08:46.470828 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466095    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.466100    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466253    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466258    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466261    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466264    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466268    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466270    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466273    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466276    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466279    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466282    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466285    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466287    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 04 22:08:46.471213 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466291    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466293    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466296    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466299    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466301    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466304    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466307    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466309    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466311    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466314    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466318    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466321    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466323    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466326    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466328    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466331    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466345    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466347    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466350    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466353    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 04 22:08:46.471562 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466355    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466358    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466360    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466363    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466365    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466368    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466370    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466373    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466375    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466378    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466380    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466383    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466385    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466388    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466390    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466393    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466395    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466398    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466401    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466403    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 04 22:08:46.472062 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466406    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466408    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466411    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466413    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466416    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466418    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466421    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466424    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466426    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466434    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466437    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466439    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466442    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466444    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466447    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466450    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466452    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466455    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466457    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466461    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 04 22:08:46.472549 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466465    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466468    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466471    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466474    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466476    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466479    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466482    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466485    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466488    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466490    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466493    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466495    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466498    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466500    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466503    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466505    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466508    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466510    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466513    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466516    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 04 22:08:46.473053 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466518    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466521    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466532    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466534    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466537    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466539    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:46.466542    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.466547    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.466665    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.469569    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.470621    2564 server.go:1019] "Starting client certificate rotation"
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.470711    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 04 22:08:46.473532 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.470744    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 04 22:08:46.478508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.478447    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 04 22:08:46.481709 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.481692    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 04 22:08:46.492759 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.492743    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 04 22:08:46.497237 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.497224    2564 log.go:25] "Validated CRI v1 image API"
Sep 04 22:08:46.498030 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.498017    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 04 22:08:46.501409 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.501390    2564 fs.go:135] Filesystem UUIDs: map[0e97208f-f957-4601-aadf-a99dd71107c6:/dev/nvme0n1p4 3b7bf9a2-052b-4410-8604-d3eca0163a2c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 04 22:08:46.501478 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.501408    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 04 22:08:46.505805 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.505785    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 04 22:08:46.507894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.507791    2564 manager.go:216] Machine: {Timestamp:2026-09-04 22:08:46.506470727 +0000 UTC m=+0.310828242 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102197 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2948e49d677bf9432eda305b5f92b2 SystemUUID:ec2948e4-9d67-7bf9-432e-da305b5f92b2 BootID:3ec3e805-eb76-45fe-9a57-e4835933ae39 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:47:c5:2d:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:47:c5:2d:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:6a:21:69:e9:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 04 22:08:46.507894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.507888    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 04 22:08:46.508005 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.507990    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 04 22:08:46.509506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.509481    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 04 22:08:46.509663 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.509514    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 04 22:08:46.510226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.510214    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 04 22:08:46.510272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.510229    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 04 22:08:46.510272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.510237    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 04 22:08:46.510272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.510256    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 04 22:08:46.511872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.511862    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 04 22:08:46.515646 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.515635    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 04 22:08:46.515774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.515764    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 04 22:08:46.515815 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.515804    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 04 22:08:46.515843 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.515820    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 04 22:08:46.515843 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.515833    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 04 22:08:46.515843 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.515841    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 04 22:08:46.515957 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.515852    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 04 22:08:46.516255 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.516244    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 04 22:08:46.516303 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.516267    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 04 22:08:46.518934 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.518918    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 04 22:08:46.521332 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.521318    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 04 22:08:46.521392 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.521348    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 04 22:08:46.522659 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522648    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 04 22:08:46.522695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522663    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 04 22:08:46.522695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522669    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 04 22:08:46.522695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522674    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 04 22:08:46.522695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522682    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 04 22:08:46.522695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522688    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 04 22:08:46.522864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522701    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 04 22:08:46.522864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522707    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 04 22:08:46.522864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522712    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 04 22:08:46.522864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522718    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 04 22:08:46.522864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522726    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 04 22:08:46.522864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.522731    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 04 22:08:46.523536 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.523526    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 04 22:08:46.523536 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.523535    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 04 22:08:46.527419 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.527398    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 04 22:08:46.527419 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.527404    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 04 22:08:46.527527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.527490    2564 server.go:1268] "Started kubelet"
Sep 04 22:08:46.527655 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.527543    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 04 22:08:46.528553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.528522    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 04 22:08:46.528677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.528562    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 04 22:08:46.528711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.528705    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 04 22:08:46.529217 ip-10-0-139-255 systemd[1]: Started Kubernetes Kubelet.
Sep 04 22:08:46.530365 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.530231    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 04 22:08:46.535641 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.535623    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 04 22:08:46.535705 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.535653    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 04 22:08:46.538745 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.538733    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 04 22:08:46.538816 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.538752    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 04 22:08:46.538875 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.538813    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:46.539146 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.537714    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-255.ec2.internal.18d23d98573d5bd6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-255.ec2.internal,UID:ip-10-0-139-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-255.ec2.internal,},FirstTimestamp:2026-09-04 22:08:46.52747055 +0000 UTC m=+0.331828065,LastTimestamp:2026-09-04 22:08:46.52747055 +0000 UTC m=+0.331828065,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-255.ec2.internal,}"
Sep 04 22:08:46.539472 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539433    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 04 22:08:46.539472 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539465    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 04 22:08:46.539617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539418    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 04 22:08:46.539617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539536    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 04 22:08:46.539617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539544    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 04 22:08:46.539617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539587    2564 factory.go:55] Registering systemd factory
Sep 04 22:08:46.539786 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539633    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 04 22:08:46.539897 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539866    2564 factory.go:153] Registering CRI-O factory
Sep 04 22:08:46.539897 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539884    2564 factory.go:223] Registration of the crio container factory successfully
Sep 04 22:08:46.540007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539935    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 04 22:08:46.540007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539958    2564 factory.go:103] Registering Raw factory
Sep 04 22:08:46.540007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.539971    2564 manager.go:1196] Started watching for new ooms in manager
Sep 04 22:08:46.540392 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.540379    2564 manager.go:349] Starting recovery of all containers
Sep 04 22:08:46.541480 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.541460    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mf257"
Sep 04 22:08:46.549759 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.549738    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 04 22:08:46.549958 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.549934    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 04 22:08:46.551531 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.551403    2564 manager.go:354] Recovery completed
Sep 04 22:08:46.552931 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.552905    2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 04 22:08:46.556209 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.556194    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 22:08:46.557708 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.557693    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 22:08:46.557755 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.557730    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 22:08:46.557755 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.557747    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientPID"
Sep 04 22:08:46.558347 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.558331    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 04 22:08:46.558347 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.558347    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 04 22:08:46.558481 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.558366    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 04 22:08:46.558481 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.558379    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 22:08:46.559098 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.559084    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 22:08:46.559174 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.559113    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 22:08:46.559174 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.559127    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientPID"
Sep 04 22:08:46.559799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.559779    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mf257"
Sep 04 22:08:46.560751 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.560737    2564 policy_none.go:49] "None policy: Start"
Sep 04 22:08:46.560810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.560755    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 04 22:08:46.560810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.560770    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 04 22:08:46.563362 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.563345    2564 policy_none.go:47] "Start"
Sep 04 22:08:46.585267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.585253    2564 manager.go:337] "Starting Device Plugin manager"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.585289    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.585301    2564 server.go:87] "Starting device plugin registration server"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.585531    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.585544    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.585778    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.585915    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.585923    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.586324    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 04 22:08:46.613557 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.586374    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:46.663075 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.663051    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 04 22:08:46.664139 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.664122    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 04 22:08:46.664210 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.664181    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 04 22:08:46.664210 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.664206    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 04 22:08:46.664281 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.664251    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 04 22:08:46.666704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.666687    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 22:08:46.685806 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.685786    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 22:08:46.686592 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.686576    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 22:08:46.686689 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.686622    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 22:08:46.686689 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.686639    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientPID"
Sep 04 22:08:46.686689 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.686668    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.702016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.701958    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.702016 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.701978    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-255.ec2.internal\": node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:46.727304 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.727281    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:46.764832 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.764801    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal"]
Sep 04 22:08:46.764919 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.764867    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 22:08:46.766133 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.766120    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 22:08:46.766178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.766145    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 22:08:46.766178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.766155    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientPID"
Sep 04 22:08:46.768368 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.768356    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 22:08:46.768475 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.768461    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.768514 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.768500    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 22:08:46.769030 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.769014    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 22:08:46.769114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.769031    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 22:08:46.769114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.769058    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 22:08:46.769114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.769069    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientPID"
Sep 04 22:08:46.769114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.769038    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 22:08:46.769247 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.769134    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientPID"
Sep 04 22:08:46.771216 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.771201    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.771305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.771224    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 04 22:08:46.771894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.771879    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 04 22:08:46.771985 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.771901    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 04 22:08:46.771985 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.771943    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeHasSufficientPID"
Sep 04 22:08:46.792105 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.792086    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-255.ec2.internal\" not found" node="ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.795979 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.795962    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-255.ec2.internal\" not found" node="ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.827633 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.827612    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:46.841973 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.841950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c577756b2aa01908cdc17cf29bbfa820-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal\" (UID: \"c577756b2aa01908cdc17cf29bbfa820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.842050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.841978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c577756b2aa01908cdc17cf29bbfa820-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal\" (UID: \"c577756b2aa01908cdc17cf29bbfa820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.842050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.841996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee8043870e702042f063468f7cb1ab5f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-255.ec2.internal\" (UID: \"ee8043870e702042f063468f7cb1ab5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.928218 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:46.928195    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:46.942244 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.942220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee8043870e702042f063468f7cb1ab5f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-255.ec2.internal\" (UID: \"ee8043870e702042f063468f7cb1ab5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.942342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.942249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c577756b2aa01908cdc17cf29bbfa820-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal\" (UID: \"c577756b2aa01908cdc17cf29bbfa820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.942342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.942276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c577756b2aa01908cdc17cf29bbfa820-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal\" (UID: \"c577756b2aa01908cdc17cf29bbfa820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.942342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.942315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c577756b2aa01908cdc17cf29bbfa820-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal\" (UID: \"c577756b2aa01908cdc17cf29bbfa820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.942342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.942324    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee8043870e702042f063468f7cb1ab5f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-255.ec2.internal\" (UID: \"ee8043870e702042f063468f7cb1ab5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:46.942487 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:46.942355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c577756b2aa01908cdc17cf29bbfa820-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal\" (UID: \"c577756b2aa01908cdc17cf29bbfa820\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:47.028498 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.028447    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.093985 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.093954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:47.098670 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.098651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:47.129302 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.129150    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.231738 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.231711    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.332947 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.332923    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.437175 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.437151    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.471181 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.471164    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 04 22:08:47.471573 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.471298    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 04 22:08:47.537631 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.537611    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.567376 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.565402    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-03 22:03:47 +0000 UTC" deadline="2028-03-25 19:58:56.50782421 +0000 UTC"
Sep 04 22:08:47.567376 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.565453    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13629h50m8.942394784s"
Sep 04 22:08:47.637969 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.637895    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.700717 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:47.700667    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee8043870e702042f063468f7cb1ab5f.slice/crio-488fff7dd6fba12652d52ede117ff96d1349dfe356cf3de382d7fa07e3b1caa1 WatchSource:0}: Error finding container 488fff7dd6fba12652d52ede117ff96d1349dfe356cf3de382d7fa07e3b1caa1: Status 404 returned error can't find the container with id 488fff7dd6fba12652d52ede117ff96d1349dfe356cf3de382d7fa07e3b1caa1
Sep 04 22:08:47.701343 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:47.701316    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc577756b2aa01908cdc17cf29bbfa820.slice/crio-28cc853deb758605d8b3b3cba66f1a8ea8e78472786cc884cb6512b605b9e3fc WatchSource:0}: Error finding container 28cc853deb758605d8b3b3cba66f1a8ea8e78472786cc884cb6512b605b9e3fc: Status 404 returned error can't find the container with id 28cc853deb758605d8b3b3cba66f1a8ea8e78472786cc884cb6512b605b9e3fc
Sep 04 22:08:47.705677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.705661    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:08:47.731646 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.731625    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 22:08:47.739061 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.739042    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.839374 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:47.839346    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-255.ec2.internal\" not found"
Sep 04 22:08:47.873360 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.873339    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 22:08:47.885389 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.885367    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 22:08:47.941778 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.941717    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:47.959346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.959329    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 04 22:08:47.960332 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:47.960318    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal"
Sep 04 22:08:48.072064 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.072038    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 04 22:08:48.516931 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.516897    2564 apiserver.go:52] "Watching apiserver"
Sep 04 22:08:48.523273 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.523243    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 04 22:08:48.525117 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.525083    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal","openshift-multus/multus-additional-cni-plugins-sjwpx","openshift-multus/multus-hnfjn","openshift-network-diagnostics/network-check-target-wmdnh","openshift-network-operator/iptables-alerter-8msxw","kube-system/global-pull-secret-syncer-zt747","kube-system/konnectivity-agent-srkj2","kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal","openshift-image-registry/node-ca-drdhf","openshift-multus/network-metrics-daemon-m6gh8","openshift-ovn-kubernetes/ovnkube-node-5mbkr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9","openshift-cluster-node-tuning-operator/tuned-84gw2","openshift-dns/node-resolver-5ngj8"]
Sep 04 22:08:48.527766 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.527727    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.530163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.530127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.530376 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.530312    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k8d8k\""
Sep 04 22:08:48.530623 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.530606    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 04 22:08:48.530791 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.530773    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 04 22:08:48.532544 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.532522    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.532668 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.532638    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-klqb5\""
Sep 04 22:08:48.532802 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.532523    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 04 22:08:48.533000 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.532983    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 04 22:08:48.534895 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.534873    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:48.534995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.534952    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 04 22:08:48.534995 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.534960    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:08:48.535285 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.535267    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 04 22:08:48.535407 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.535388    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 04 22:08:48.535517 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.535501    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 04 22:08:48.535660 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.535640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-scc45\""
Sep 04 22:08:48.537176 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.537155    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.539364 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.539346    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 04 22:08:48.539714 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.539686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.539804 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.539774    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:08:48.540490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.540117    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 04 22:08:48.540490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.540145    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 04 22:08:48.540490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.540308    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8gqfs\""
Sep 04 22:08:48.540490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.540358    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 04 22:08:48.542191 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.542171    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.544551 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.544526    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 04 22:08:48.544640 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.544590    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 04 22:08:48.544712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.544656    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8lpx4\""
Sep 04 22:08:48.545031 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.545014    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 04 22:08:48.545365 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.545265    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.547526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.547472    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 04 22:08:48.547526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.547499    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lnwtj\""
Sep 04 22:08:48.547689 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.547539    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 04 22:08:48.548392 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.548204    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.551144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.550260    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:48.551144 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.550327    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:08:48.551144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.550419    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n8zhp\""
Sep 04 22:08:48.551144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.550761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 04 22:08:48.551144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.550988    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 04 22:08:48.551500 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-cni-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.551500 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-cni-binary-copy\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.551500 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-socket-dir-parent\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.551500 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0b1b91b-5027-47e3-a430-0893273fdadb-iptables-alerter-script\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ad471ec-b404-491c-81d9-b5fa38c02d44-kubelet-config\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-kubernetes\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysctl-conf\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-sys\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-host\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0b1b91b-5027-47e3-a430-0893273fdadb-host-slash\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ad471ec-b404-491c-81d9-b5fa38c02d44-dbus\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-run\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-etc-kubernetes\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.551796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.552328 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysconfig\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.552328 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysctl-d\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.552328 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.551879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-lib-modules\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.552851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa611796-403e-47b5-8526-64438e6d2c4f-tmp\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.552937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-system-cni-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.552976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-cni-bin\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-kubelet\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/313f3fe7-3563-45df-8985-2dc4e9f73132-agent-certs\") pod \"konnectivity-agent-srkj2\" (UID: \"313f3fe7-3563-45df-8985-2dc4e9f73132\") " pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/313f3fe7-3563-45df-8985-2dc4e9f73132-konnectivity-ca\") pod \"konnectivity-agent-srkj2\" (UID: \"313f3fe7-3563-45df-8985-2dc4e9f73132\") " pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-daemon-config\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-systemd\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwc29\" (UniqueName: \"kubernetes.io/projected/fa611796-403e-47b5-8526-64438e6d2c4f-kube-api-access-pwc29\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-cnibin\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-k8s-cni-cncf-io\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-hostroot\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-conf-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9fq9\" (UniqueName: \"kubernetes.io/projected/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-kube-api-access-s9fq9\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-var-lib-kubelet\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-netns\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.559711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:48.560645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.553822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9sl\" (UniqueName: \"kubernetes.io/projected/b0b1b91b-5027-47e3-a430-0893273fdadb-kube-api-access-7m9sl\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.560645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.554031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-modprobe-d\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.560645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.554064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa611796-403e-47b5-8526-64438e6d2c4f-etc-tuned\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.560645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.554100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-cni-multus\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.560645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.554133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-multus-certs\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.565110 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.563422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.566648 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.565540    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 04 22:08:48.566648 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.566067    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 04 22:08:48.568298 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.567299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.569050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.568501    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 04 22:08:48.569050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.568591    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m4z7k\""
Sep 04 22:08:48.569050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.568707    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 04 22:08:48.569050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.568764    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 04 22:08:48.569050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.568812    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 04 22:08:48.569050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.568505    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 04 22:08:48.571971 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.571950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 04 22:08:48.574928 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.572716    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 04 22:08:48.574928 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.572997    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 04 22:08:48.574928 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.573198    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pr64g\""
Sep 04 22:08:48.596073 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.596036    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p847w"
Sep 04 22:08:48.605129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.605110    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p847w"
Sep 04 22:08:48.640532 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.640498    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 04 22:08:48.654714 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-daemon-config\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.654834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.654834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-system-cni-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.654834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-cni-bin\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.654834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-cni-bin\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.655053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/313f3fe7-3563-45df-8985-2dc4e9f73132-agent-certs\") pod \"konnectivity-agent-srkj2\" (UID: \"313f3fe7-3563-45df-8985-2dc4e9f73132\") " pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.655053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-cni-bin\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655053 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.654940    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:48.655053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.654962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-system-cni-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655053 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.655040    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret podName:9ad471ec-b404-491c-81d9-b5fa38c02d44 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:49.15499787 +0000 UTC m=+2.959355391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret") pod "global-pull-secret-syncer-zt747" (UID: "9ad471ec-b404-491c-81d9-b5fa38c02d44") : object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:48.655330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/313f3fe7-3563-45df-8985-2dc4e9f73132-konnectivity-ca\") pod \"konnectivity-agent-srkj2\" (UID: \"313f3fe7-3563-45df-8985-2dc4e9f73132\") " pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.655330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-socket-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.655330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-var-lib-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.655330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwc29\" (UniqueName: \"kubernetes.io/projected/fa611796-403e-47b5-8526-64438e6d2c4f-kube-api-access-pwc29\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.655330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-cnibin\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-conf-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655237    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-daemon-config\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-cnibin\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-conf-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-systemd\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-log-socket\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-var-lib-kubelet\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-netns\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9sl\" (UniqueName: \"kubernetes.io/projected/b0b1b91b-5027-47e3-a430-0893273fdadb-kube-api-access-7m9sl\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-var-lib-kubelet\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-netns\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.655712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/313f3fe7-3563-45df-8985-2dc4e9f73132-konnectivity-ca\") pod \"konnectivity-agent-srkj2\" (UID: \"313f3fe7-3563-45df-8985-2dc4e9f73132\") " pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq859\" (UniqueName: \"kubernetes.io/projected/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-kube-api-access-xq859\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-modprobe-d\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa611796-403e-47b5-8526-64438e6d2c4f-etc-tuned\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqs6t\" (UniqueName: \"kubernetes.io/projected/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-kube-api-access-kqs6t\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-env-overrides\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-modprobe-d\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-socket-dir-parent\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.655988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovn-node-metrics-cert\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ad471ec-b404-491c-81d9-b5fa38c02d44-kubelet-config\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-socket-dir-parent\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysctl-conf\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.656426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-host\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc7mk\" (UniqueName: \"kubernetes.io/projected/9fd25bf3-5aaf-4857-848b-ffd92edb4528-kube-api-access-nc7mk\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ad471ec-b404-491c-81d9-b5fa38c02d44-kubelet-config\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4grh\" (UniqueName: \"kubernetes.io/projected/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-kube-api-access-b4grh\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79k5w\" (UniqueName: \"kubernetes.io/projected/b3f6f05c-3c83-4651-b5c8-43e643e24496-kube-api-access-79k5w\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ad471ec-b404-491c-81d9-b5fa38c02d44-dbus\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-run\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-kubelet\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-ovn\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-node-log\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysconfig\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysctl-conf\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-host\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysctl-d\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-lib-modules\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysconfig\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.657288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-lib-modules\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa611796-403e-47b5-8526-64438e6d2c4f-tmp\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-kubelet\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-sysctl-d\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656676    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-slash\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-cni-netd\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-kubelet\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656830    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ad471ec-b404-491c-81d9-b5fa38c02d44-dbus\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-run\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-device-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovnkube-script-lib\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-systemd\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.656989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-k8s-cni-cncf-io\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-hostroot\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9fq9\" (UniqueName: \"kubernetes.io/projected/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-kube-api-access-s9fq9\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fcb5d90-7077-4d96-aa70-ff55659d199b-host\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:48.658178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-registration-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-sys-fs\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-cni-multus\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-multus-certs\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fcb5d90-7077-4d96-aa70-ff55659d199b-serviceca\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-tmp-dir\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-cni-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-cni-binary-copy\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0b1b91b-5027-47e3-a430-0893273fdadb-iptables-alerter-script\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-systemd-units\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-kubernetes\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-sys\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0b1b91b-5027-47e3-a430-0893273fdadb-host-slash\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgb4p\" (UniqueName: \"kubernetes.io/projected/0fcb5d90-7077-4d96-aa70-ff55659d199b-kube-api-access-xgb4p\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cnibin\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.659081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-system-cni-dir\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-etc-kubernetes\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-hosts-file\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-run-netns\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.657983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-etc-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.658009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovnkube-config\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.658108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-systemd\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.658160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-k8s-cni-cncf-io\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.658194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-hostroot\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.658441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-var-lib-cni-multus\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.658482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-host-run-multus-certs\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.658533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-multus-cni-dir\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.659068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-cni-binary-copy\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.659542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0b1b91b-5027-47e3-a430-0893273fdadb-iptables-alerter-script\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.659606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-etc-kubernetes\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.659627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-etc-kubernetes\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.659675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0b1b91b-5027-47e3-a430-0893273fdadb-host-slash\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.659933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.659669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa611796-403e-47b5-8526-64438e6d2c4f-sys\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.663177 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.663152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa611796-403e-47b5-8526-64438e6d2c4f-tmp\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.664460 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.664389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/313f3fe7-3563-45df-8985-2dc4e9f73132-agent-certs\") pod \"konnectivity-agent-srkj2\" (UID: \"313f3fe7-3563-45df-8985-2dc4e9f73132\") " pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.666414 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.666307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa611796-403e-47b5-8526-64438e6d2c4f-etc-tuned\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.669874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.669786    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal" event={"ID":"c577756b2aa01908cdc17cf29bbfa820","Type":"ContainerStarted","Data":"28cc853deb758605d8b3b3cba66f1a8ea8e78472786cc884cb6512b605b9e3fc"}
Sep 04 22:08:48.671933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.671848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwc29\" (UniqueName: \"kubernetes.io/projected/fa611796-403e-47b5-8526-64438e6d2c4f-kube-api-access-pwc29\") pod \"tuned-84gw2\" (UID: \"fa611796-403e-47b5-8526-64438e6d2c4f\") " pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.671933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.671907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal" event={"ID":"ee8043870e702042f063468f7cb1ab5f","Type":"ContainerStarted","Data":"488fff7dd6fba12652d52ede117ff96d1349dfe356cf3de382d7fa07e3b1caa1"}
Sep 04 22:08:48.674354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.674331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9fq9\" (UniqueName: \"kubernetes.io/projected/41b72f76-3a05-4034-9d1e-7c8d4b4dd3da-kube-api-access-s9fq9\") pod \"multus-hnfjn\" (UID: \"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da\") " pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.674523 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.674502    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 22:08:48.674589 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.674532    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 22:08:48.674589 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.674547    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dr8kd for pod openshift-network-diagnostics/network-check-target-wmdnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:48.674758 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.674614    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd podName:b61480f6-0147-45a4-b154-402a2582e238 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:49.174596178 +0000 UTC m=+2.978953702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dr8kd" (UniqueName: "kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd") pod "network-check-target-wmdnh" (UID: "b61480f6-0147-45a4-b154-402a2582e238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:48.675385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.675361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9sl\" (UniqueName: \"kubernetes.io/projected/b0b1b91b-5027-47e3-a430-0893273fdadb-kube-api-access-7m9sl\") pod \"iptables-alerter-8msxw\" (UID: \"b0b1b91b-5027-47e3-a430-0893273fdadb\") " pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.758832 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-kubelet\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-ovn\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-node-log\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-slash\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-ovn\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758921    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-kubelet\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-cni-netd\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-node-log\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-device-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovnkube-script-lib\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-device-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.758964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-slash\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759065    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-cni-netd\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fcb5d90-7077-4d96-aa70-ff55659d199b-host\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-registration-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-sys-fs\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fcb5d90-7077-4d96-aa70-ff55659d199b-host\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-registration-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.759254    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-sys-fs\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:48.759313    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:49.259292993 +0000 UTC m=+3.063650502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fcb5d90-7077-4d96-aa70-ff55659d199b-serviceca\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.759397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-tmp-dir\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-systemd-units\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgb4p\" (UniqueName: \"kubernetes.io/projected/0fcb5d90-7077-4d96-aa70-ff55659d199b-kube-api-access-xgb4p\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cnibin\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-system-cni-dir\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-hosts-file\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-run-netns\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-etc-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovnkube-config\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-cni-bin\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-socket-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-var-lib-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-systemd\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-log-socket\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq859\" (UniqueName: \"kubernetes.io/projected/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-kube-api-access-xq859\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqs6t\" (UniqueName: \"kubernetes.io/projected/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-kube-api-access-kqs6t\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cnibin\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-system-cni-dir\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760054    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-var-lib-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-hosts-file\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-run-netns\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-etc-openvswitch\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fcb5d90-7077-4d96-aa70-ff55659d199b-serviceca\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-env-overrides\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovn-node-metrics-cert\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.760878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc7mk\" (UniqueName: \"kubernetes.io/projected/9fd25bf3-5aaf-4857-848b-ffd92edb4528-kube-api-access-nc7mk\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4grh\" (UniqueName: \"kubernetes.io/projected/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-kube-api-access-b4grh\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79k5w\" (UniqueName: \"kubernetes.io/projected/b3f6f05c-3c83-4651-b5c8-43e643e24496-kube-api-access-79k5w\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-log-socket\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovnkube-config\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-systemd-units\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-cni-bin\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.759709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovnkube-script-lib\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.760877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-run-systemd\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.761053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.761260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.761310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9fd25bf3-5aaf-4857-848b-ffd92edb4528-socket-dir\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.761700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.761408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-env-overrides\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.762477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.761526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-tmp-dir\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.762477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.762080    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.763865 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.763785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-ovn-node-metrics-cert\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.784213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.784156    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgb4p\" (UniqueName: \"kubernetes.io/projected/0fcb5d90-7077-4d96-aa70-ff55659d199b-kube-api-access-xgb4p\") pod \"node-ca-drdhf\" (UID: \"0fcb5d90-7077-4d96-aa70-ff55659d199b\") " pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.787680 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.787646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4grh\" (UniqueName: \"kubernetes.io/projected/55666064-c8a5-4d05-9b9c-b255bc3b0d4a-kube-api-access-b4grh\") pod \"node-resolver-5ngj8\" (UID: \"55666064-c8a5-4d05-9b9c-b255bc3b0d4a\") " pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.788297 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.788258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79k5w\" (UniqueName: \"kubernetes.io/projected/b3f6f05c-3c83-4651-b5c8-43e643e24496-kube-api-access-79k5w\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:48.790137 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.790102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc7mk\" (UniqueName: \"kubernetes.io/projected/9fd25bf3-5aaf-4857-848b-ffd92edb4528-kube-api-access-nc7mk\") pod \"aws-ebs-csi-driver-node-bmdn9\" (UID: \"9fd25bf3-5aaf-4857-848b-ffd92edb4528\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.793160 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.793128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq859\" (UniqueName: \"kubernetes.io/projected/6c9d3d20-2f44-47c4-b273-d494dd0a41aa-kube-api-access-xq859\") pod \"ovnkube-node-5mbkr\" (UID: \"6c9d3d20-2f44-47c4-b273-d494dd0a41aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.793578 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.793534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqs6t\" (UniqueName: \"kubernetes.io/projected/e0c78e1d-3a62-4d8e-b8a0-a6c673966222-kube-api-access-kqs6t\") pod \"multus-additional-cni-plugins-sjwpx\" (UID: \"e0c78e1d-3a62-4d8e-b8a0-a6c673966222\") " pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.844315 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.844280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:08:48.850445 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.850414    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84gw2"
Sep 04 22:08:48.868445 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.868407    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hnfjn"
Sep 04 22:08:48.879445 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.879422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8msxw"
Sep 04 22:08:48.890680 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.890655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-drdhf"
Sep 04 22:08:48.899197 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.899121    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ngj8"
Sep 04 22:08:48.906927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.906898    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjwpx"
Sep 04 22:08:48.916079 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.916058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:08:48.923008 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.922984    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9"
Sep 04 22:08:48.930172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:48.930153    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 04 22:08:49.163919 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:49.163877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:49.164117 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.164024    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:49.164117 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.164102    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret podName:9ad471ec-b404-491c-81d9-b5fa38c02d44 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:50.16408369 +0000 UTC m=+3.968441220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret") pod "global-pull-secret-syncer-zt747" (UID: "9ad471ec-b404-491c-81d9-b5fa38c02d44") : object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:49.265285 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:49.265252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:49.265480 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:49.265315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:49.265480 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.265456    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:49.265480 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.265472    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 22:08:49.265642 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.265490    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 22:08:49.265642 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.265500    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dr8kd for pod openshift-network-diagnostics/network-check-target-wmdnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:49.265642 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.265542    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:50.265518748 +0000 UTC m=+4.069876320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:49.265642 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.265564    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd podName:b61480f6-0147-45a4-b154-402a2582e238 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:50.265553339 +0000 UTC m=+4.069910852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dr8kd" (UniqueName: "kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd") pod "network-check-target-wmdnh" (UID: "b61480f6-0147-45a4-b154-402a2582e238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:49.609466 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:49.609427    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-03 22:03:49 +0000 UTC" deadline="2028-02-06 02:42:27.802158102 +0000 UTC"
Sep 04 22:08:49.609466 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:49.609458    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12460h33m38.192704123s"
Sep 04 22:08:49.665123 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:49.665087    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:49.665303 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:49.665137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:49.665303 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.665223    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:08:49.665423 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:49.665360    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:08:49.760708 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.760668    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b72f76_3a05_4034_9d1e_7c8d4b4dd3da.slice/crio-3c5cd0a5d24de00dd0a43ba3b5c1f21b878cc3c058a654fa1c4cf414ffd83254 WatchSource:0}: Error finding container 3c5cd0a5d24de00dd0a43ba3b5c1f21b878cc3c058a654fa1c4cf414ffd83254: Status 404 returned error can't find the container with id 3c5cd0a5d24de00dd0a43ba3b5c1f21b878cc3c058a654fa1c4cf414ffd83254
Sep 04 22:08:49.762453 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.762384    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b1b91b_5027_47e3_a430_0893273fdadb.slice/crio-4de0d4b67511c76819a0fc5078114b76a7272e998aec702a5da15b39778ed66a WatchSource:0}: Error finding container 4de0d4b67511c76819a0fc5078114b76a7272e998aec702a5da15b39778ed66a: Status 404 returned error can't find the container with id 4de0d4b67511c76819a0fc5078114b76a7272e998aec702a5da15b39778ed66a
Sep 04 22:08:49.766733 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.766698    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa611796_403e_47b5_8526_64438e6d2c4f.slice/crio-6197e827a9344b7586188430a56c94dd2c5ab65d4b48f32679053665aed03b2b WatchSource:0}: Error finding container 6197e827a9344b7586188430a56c94dd2c5ab65d4b48f32679053665aed03b2b: Status 404 returned error can't find the container with id 6197e827a9344b7586188430a56c94dd2c5ab65d4b48f32679053665aed03b2b
Sep 04 22:08:49.767512 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.767423    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313f3fe7_3563_45df_8985_2dc4e9f73132.slice/crio-1d4185878a18b37fa5dd65306caac630e67f75cda4d262068df56751e1481d40 WatchSource:0}: Error finding container 1d4185878a18b37fa5dd65306caac630e67f75cda4d262068df56751e1481d40: Status 404 returned error can't find the container with id 1d4185878a18b37fa5dd65306caac630e67f75cda4d262068df56751e1481d40
Sep 04 22:08:49.769009 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.768983    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd25bf3_5aaf_4857_848b_ffd92edb4528.slice/crio-8f13d4b758f4f1c688a1659be6de21927ad94944f0cfaa0bd36c00a9eeeb9854 WatchSource:0}: Error finding container 8f13d4b758f4f1c688a1659be6de21927ad94944f0cfaa0bd36c00a9eeeb9854: Status 404 returned error can't find the container with id 8f13d4b758f4f1c688a1659be6de21927ad94944f0cfaa0bd36c00a9eeeb9854
Sep 04 22:08:49.770856 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.770802    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9d3d20_2f44_47c4_b273_d494dd0a41aa.slice/crio-1fe15d906a21abe4def24f5489da413875b45029fd4c9e2c6206a4c09f4e2002 WatchSource:0}: Error finding container 1fe15d906a21abe4def24f5489da413875b45029fd4c9e2c6206a4c09f4e2002: Status 404 returned error can't find the container with id 1fe15d906a21abe4def24f5489da413875b45029fd4c9e2c6206a4c09f4e2002
Sep 04 22:08:49.772510 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.772488    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c78e1d_3a62_4d8e_b8a0_a6c673966222.slice/crio-4aa63f715a0a3bca3bfbc4739b9bf408ccc227afe7c168c705f825e9db613237 WatchSource:0}: Error finding container 4aa63f715a0a3bca3bfbc4739b9bf408ccc227afe7c168c705f825e9db613237: Status 404 returned error can't find the container with id 4aa63f715a0a3bca3bfbc4739b9bf408ccc227afe7c168c705f825e9db613237
Sep 04 22:08:49.774224 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.774188    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55666064_c8a5_4d05_9b9c_b255bc3b0d4a.slice/crio-ffb717ba678842f77a97e0043e1ace7d29aa200a9448639341c1e1c46915f413 WatchSource:0}: Error finding container ffb717ba678842f77a97e0043e1ace7d29aa200a9448639341c1e1c46915f413: Status 404 returned error can't find the container with id ffb717ba678842f77a97e0043e1ace7d29aa200a9448639341c1e1c46915f413
Sep 04 22:08:49.775097 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:08:49.775057    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcb5d90_7077_4d96_aa70_ff55659d199b.slice/crio-bcbe61a95c8e66b186db665c74958edaef354fd96f67be7fa0347c8344bde5a3 WatchSource:0}: Error finding container bcbe61a95c8e66b186db665c74958edaef354fd96f67be7fa0347c8344bde5a3: Status 404 returned error can't find the container with id bcbe61a95c8e66b186db665c74958edaef354fd96f67be7fa0347c8344bde5a3
Sep 04 22:08:50.172856 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.172541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:50.172982 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.172697    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:50.172982 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.172943    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret podName:9ad471ec-b404-491c-81d9-b5fa38c02d44 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:52.172922033 +0000 UTC m=+5.977279562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret") pod "global-pull-secret-syncer-zt747" (UID: "9ad471ec-b404-491c-81d9-b5fa38c02d44") : object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:50.273676 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.273580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:50.273837 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.273688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:50.273837 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.273769    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:50.273837 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.273817    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 22:08:50.273837 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.273834    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 22:08:50.274055 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.273847    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dr8kd for pod openshift-network-diagnostics/network-check-target-wmdnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:50.274055 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.273851    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:52.273830349 +0000 UTC m=+6.078187853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:50.274055 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.273897    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd podName:b61480f6-0147-45a4-b154-402a2582e238 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:52.27388252 +0000 UTC m=+6.078240028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dr8kd" (UniqueName: "kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd") pod "network-check-target-wmdnh" (UID: "b61480f6-0147-45a4-b154-402a2582e238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:50.610030 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.609958    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-03 22:03:49 +0000 UTC" deadline="2028-03-20 05:10:58.438983739 +0000 UTC"
Sep 04 22:08:50.610030 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.610027    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13495h2m7.82896084s"
Sep 04 22:08:50.667694 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.667160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:50.667694 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:50.667312    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:08:50.691082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.691045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9" event={"ID":"9fd25bf3-5aaf-4857-848b-ffd92edb4528","Type":"ContainerStarted","Data":"8f13d4b758f4f1c688a1659be6de21927ad94944f0cfaa0bd36c00a9eeeb9854"}
Sep 04 22:08:50.704107 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.704018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srkj2" event={"ID":"313f3fe7-3563-45df-8985-2dc4e9f73132","Type":"ContainerStarted","Data":"1d4185878a18b37fa5dd65306caac630e67f75cda4d262068df56751e1481d40"}
Sep 04 22:08:50.722592 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.722524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84gw2" event={"ID":"fa611796-403e-47b5-8526-64438e6d2c4f","Type":"ContainerStarted","Data":"6197e827a9344b7586188430a56c94dd2c5ab65d4b48f32679053665aed03b2b"}
Sep 04 22:08:50.736729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.736699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8msxw" event={"ID":"b0b1b91b-5027-47e3-a430-0893273fdadb","Type":"ContainerStarted","Data":"4de0d4b67511c76819a0fc5078114b76a7272e998aec702a5da15b39778ed66a"}
Sep 04 22:08:50.748547 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.748516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal" event={"ID":"ee8043870e702042f063468f7cb1ab5f","Type":"ContainerStarted","Data":"768fbb51e58822ec128bb760926bb0307a5af5ce8f141da312318f9282c26be7"}
Sep 04 22:08:50.751771 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.751706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-drdhf" event={"ID":"0fcb5d90-7077-4d96-aa70-ff55659d199b","Type":"ContainerStarted","Data":"bcbe61a95c8e66b186db665c74958edaef354fd96f67be7fa0347c8344bde5a3"}
Sep 04 22:08:50.761252 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.761141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"1fe15d906a21abe4def24f5489da413875b45029fd4c9e2c6206a4c09f4e2002"}
Sep 04 22:08:50.764775 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.764718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hnfjn" event={"ID":"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da","Type":"ContainerStarted","Data":"3c5cd0a5d24de00dd0a43ba3b5c1f21b878cc3c058a654fa1c4cf414ffd83254"}
Sep 04 22:08:50.781476 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.781446    2564 generic.go:356] "Generic (PLEG): container finished" podID="c577756b2aa01908cdc17cf29bbfa820" containerID="331abae28b20a67b5cfd1b8172706d9db22f0415083ff268e95cad08564e5f2e" exitCode=0
Sep 04 22:08:50.781568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.781530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal" event={"ID":"c577756b2aa01908cdc17cf29bbfa820","Type":"ContainerDied","Data":"331abae28b20a67b5cfd1b8172706d9db22f0415083ff268e95cad08564e5f2e"}
Sep 04 22:08:50.786763 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.786738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ngj8" event={"ID":"55666064-c8a5-4d05-9b9c-b255bc3b0d4a","Type":"ContainerStarted","Data":"ffb717ba678842f77a97e0043e1ace7d29aa200a9448639341c1e1c46915f413"}
Sep 04 22:08:50.804851 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.804769    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerStarted","Data":"4aa63f715a0a3bca3bfbc4739b9bf408ccc227afe7c168c705f825e9db613237"}
Sep 04 22:08:50.815598 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:50.815550    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-255.ec2.internal" podStartSLOduration=2.815531457 podStartE2EDuration="2.815531457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:08:50.771875289 +0000 UTC m=+4.576232845" watchObservedRunningTime="2026-09-04 22:08:50.815531457 +0000 UTC m=+4.619888990"
Sep 04 22:08:51.665305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:51.665254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:51.665788 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:51.665411    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:08:51.665860 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:51.665832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:51.665964 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:51.665941    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:08:51.829092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:51.829010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal" event={"ID":"c577756b2aa01908cdc17cf29bbfa820","Type":"ContainerStarted","Data":"b8a8e78759ad37301071331c06233b1d5224fb0bf64fa247f3d72aa301be5f22"}
Sep 04 22:08:52.192662 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:52.192574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:52.192875 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.192774    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:52.192875 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.192847    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret podName:9ad471ec-b404-491c-81d9-b5fa38c02d44 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:56.192825524 +0000 UTC m=+9.997183050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret") pod "global-pull-secret-syncer-zt747" (UID: "9ad471ec-b404-491c-81d9-b5fa38c02d44") : object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:52.293974 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:52.293934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:52.294164 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:52.294014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:52.294242 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.294172    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 22:08:52.294242 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.294192    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 22:08:52.294242 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.294207    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dr8kd for pod openshift-network-diagnostics/network-check-target-wmdnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:52.294396 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.294270    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd podName:b61480f6-0147-45a4-b154-402a2582e238 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:56.294249223 +0000 UTC m=+10.098606745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dr8kd" (UniqueName: "kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd") pod "network-check-target-wmdnh" (UID: "b61480f6-0147-45a4-b154-402a2582e238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:52.294396 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.294345    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:52.294396 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.294381    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:08:56.294368987 +0000 UTC m=+10.098726508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:52.667449 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:52.665234    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:52.667965 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:52.667579    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:08:53.665715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:53.665640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:53.665715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:53.665700    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:53.665986 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:53.665893    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:08:53.666071 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:53.666018    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:08:54.665422 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:54.665365    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:54.666045 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:54.665508    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:08:55.665442 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:55.665404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:55.665858 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:55.665413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:55.665858 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:55.665519    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:08:55.665858 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:55.665621    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:08:56.231356 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:56.231323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:56.231527 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.231507    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:56.231588 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.231575    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret podName:9ad471ec-b404-491c-81d9-b5fa38c02d44 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:04.231556672 +0000 UTC m=+18.035914180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret") pod "global-pull-secret-syncer-zt747" (UID: "9ad471ec-b404-491c-81d9-b5fa38c02d44") : object "kube-system"/"original-pull-secret" not registered
Sep 04 22:08:56.332064 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:56.331995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:56.332228 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.332170    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 22:08:56.332228 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.332192    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 22:08:56.332228 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.332207    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dr8kd for pod openshift-network-diagnostics/network-check-target-wmdnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:56.332457 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.332260    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd podName:b61480f6-0147-45a4-b154-402a2582e238 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:04.33224326 +0000 UTC m=+18.136600779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dr8kd" (UniqueName: "kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd") pod "network-check-target-wmdnh" (UID: "b61480f6-0147-45a4-b154-402a2582e238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:08:56.332457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:56.332324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:56.332457 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.332447    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:56.332631 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.332497    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:04.332481211 +0000 UTC m=+18.136838727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:08:56.666041 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:56.666007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:56.666477 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:56.666127    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:08:57.665040 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:57.665009    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:57.665206 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:57.665155    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:08:57.665258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:57.665210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:57.665335 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:57.665314    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:08:58.664528 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:58.664493    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:08:58.665005 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:58.664654    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:08:59.664852 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:59.664821    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:08:59.665275 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:59.664935    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:08:59.665275 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:08:59.664991    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:08:59.665275 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:08:59.665100    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:00.664713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:00.664674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:00.664873 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:00.664810    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:01.664802 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:01.664762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:01.664979 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:01.664763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:01.665342 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:01.664969    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:01.665342 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:01.665116    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:02.664668 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:02.664632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:02.664836 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:02.664764    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:03.665446 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:03.665410    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:03.665904 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:03.665453    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:03.665904 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:03.665540    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:03.665904 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:03.665658    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:04.290097 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:04.290062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:04.290279 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.290228    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 22:09:04.290349 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.290300    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret podName:9ad471ec-b404-491c-81d9-b5fa38c02d44 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:20.290279532 +0000 UTC m=+34.094637034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret") pod "global-pull-secret-syncer-zt747" (UID: "9ad471ec-b404-491c-81d9-b5fa38c02d44") : object "kube-system"/"original-pull-secret" not registered
Sep 04 22:09:04.391369 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:04.391336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:04.391553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:04.391401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:04.391553 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.391501    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:09:04.391553 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.391515    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 22:09:04.391553 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.391540    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 22:09:04.391553 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.391553    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dr8kd for pod openshift-network-diagnostics/network-check-target-wmdnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:09:04.391816 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.391561    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:20.391547371 +0000 UTC m=+34.195904873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:09:04.391816 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.391592    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd podName:b61480f6-0147-45a4-b154-402a2582e238 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:20.391581346 +0000 UTC m=+34.195938848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dr8kd" (UniqueName: "kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd") pod "network-check-target-wmdnh" (UID: "b61480f6-0147-45a4-b154-402a2582e238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:09:04.664904 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:04.664875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:04.665044 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:04.664979    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:05.664414 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:05.664377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:05.664896 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:05.664500    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:05.664896 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:05.664589    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:05.664896 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:05.664712    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:06.666213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:06.666180    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:06.669100 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:06.666662    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:07.664568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.664430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:07.664688 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.664497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:07.664723 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:07.664685    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:07.664778 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:07.664754    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:07.867222 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.867196    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-drdhf" event={"ID":"0fcb5d90-7077-4d96-aa70-ff55659d199b","Type":"ContainerStarted","Data":"4e3c98df460846373569e346c2fc4cf126800e30f5f6f2bb1d3a36fc35647f25"}
Sep 04 22:09:07.869528 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.869505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"bb885a435374e100f27072e39e258fe66f539e59a264403df212b4cd07fe5afd"}
Sep 04 22:09:07.869652 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.869578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"61cd51afa0d6fc138c8b9f35f0b2ff61641f6e1ff9270526e267c260312d8da0"}
Sep 04 22:09:07.869723 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.869655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"a8d4ebae064fe7a8c9412778ed00fbbdff968d1bb30f0d277bf5e24c3ffbecb6"}
Sep 04 22:09:07.869723 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.869706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"10ba96887dcdafd6518f6529338e929101e555d599af89c01d4451e9262a9bc2"}
Sep 04 22:09:07.871557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.871538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hnfjn" event={"ID":"41b72f76-3a05-4034-9d1e-7c8d4b4dd3da","Type":"ContainerStarted","Data":"8ba8fe5eeab143f97fd1d731a2eb40cb98b05767bb8b5c3bc22ddd868b1f877f"}
Sep 04 22:09:07.872953 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.872922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ngj8" event={"ID":"55666064-c8a5-4d05-9b9c-b255bc3b0d4a","Type":"ContainerStarted","Data":"d155cb88f5d264c4139f3fb34f1568b2598706169ef3a9a87853b4e2c445c688"}
Sep 04 22:09:07.874406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.874384    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0c78e1d-3a62-4d8e-b8a0-a6c673966222" containerID="b3b01da82f8439a7176901345f0ae1b1fdfc4c7cbb604250443f361e77afefcb" exitCode=0
Sep 04 22:09:07.874485 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.874455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerDied","Data":"b3b01da82f8439a7176901345f0ae1b1fdfc4c7cbb604250443f361e77afefcb"}
Sep 04 22:09:07.876086 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.876036    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9" event={"ID":"9fd25bf3-5aaf-4857-848b-ffd92edb4528","Type":"ContainerStarted","Data":"a079234691d05d416800ce3259dcc7f9c4cbe42e5bb0314fd2379a4a8990484a"}
Sep 04 22:09:07.880383 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.880356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srkj2" event={"ID":"313f3fe7-3563-45df-8985-2dc4e9f73132","Type":"ContainerStarted","Data":"b678484b6580e6948f61f0917f13e942f0b8df91f96779aec77589b46b0759e6"}
Sep 04 22:09:07.881717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.881697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84gw2" event={"ID":"fa611796-403e-47b5-8526-64438e6d2c4f","Type":"ContainerStarted","Data":"4d24caf9273e92ea942c23651bfbd9c397e7ddaad823cda6fdf26ae3b41633e4"}
Sep 04 22:09:07.887037 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.887003    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-255.ec2.internal" podStartSLOduration=19.886992876 podStartE2EDuration="19.886992876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:08:51.862413191 +0000 UTC m=+5.666770721" watchObservedRunningTime="2026-09-04 22:09:07.886992876 +0000 UTC m=+21.691350400"
Sep 04 22:09:07.903454 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.903416    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-drdhf" podStartSLOduration=7.193596765 podStartE2EDuration="20.903404864s" totalImagesPullingTime="13.709808099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:07.886722688 +0000 UTC m=+21.691080212" watchObservedRunningTime="2026-09-04 22:09:07.903404864 +0000 UTC m=+21.707762387"
Sep 04 22:09:07.927294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.927210    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-srkj2" podStartSLOduration=7.188075497 podStartE2EDuration="20.927194705s" totalImagesPullingTime="13.739119208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:07.903523013 +0000 UTC m=+21.707880520" watchObservedRunningTime="2026-09-04 22:09:07.927194705 +0000 UTC m=+21.731552242"
Sep 04 22:09:07.927855 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.927817    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-84gw2" podStartSLOduration=3.31613169 podStartE2EDuration="20.927802082s" totalImagesPullingTime="17.611670392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:07.927439973 +0000 UTC m=+21.731797497" watchObservedRunningTime="2026-09-04 22:09:07.927802082 +0000 UTC m=+21.732159608"
Sep 04 22:09:07.951932 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:07.951903    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hnfjn" podStartSLOduration=3.249256509 podStartE2EDuration="20.951894946s" totalImagesPullingTime="17.702638437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:07.951551226 +0000 UTC m=+21.755908751" watchObservedRunningTime="2026-09-04 22:09:07.951894946 +0000 UTC m=+21.756252471"
Sep 04 22:09:08.025223 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.025187    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5ngj8" podStartSLOduration=3.509208169 podStartE2EDuration="21.025174495s" totalImagesPullingTime="17.515966326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:07.971777769 +0000 UTC m=+21.776135315" watchObservedRunningTime="2026-09-04 22:09:08.025174495 +0000 UTC m=+21.829532079"
Sep 04 22:09:08.665299 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.665228    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:08.665491 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:08.665348    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:08.727925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.727899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:09:08.728489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.728469    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:09:08.804527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.804498    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 04 22:09:08.887570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.887540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"97c05ba6db60a5601663446fa4f1561a866f774d24d0a7c418e56d2d92c959ad"}
Sep 04 22:09:08.887967 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.887662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"52c0a83755ceba34895c39757fc30e46320008eb189f997e9d22d0e9688fe887"}
Sep 04 22:09:08.889738 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.889707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9" event={"ID":"9fd25bf3-5aaf-4857-848b-ffd92edb4528","Type":"ContainerStarted","Data":"228a8c6e81ac851cfd5f609a64748e84f74acdc9b42586be75c131cc5bf2ae99"}
Sep 04 22:09:08.891451 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.891423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8msxw" event={"ID":"b0b1b91b-5027-47e3-a430-0893273fdadb","Type":"ContainerStarted","Data":"50b85cfc618f08112fb8a256f4791718620cb8b46d82a689b5caa1ece38b46ce"}
Sep 04 22:09:08.892226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.892163    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:09:08.892226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.892220    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-srkj2"
Sep 04 22:09:08.909206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:08.909165    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8msxw" podStartSLOduration=4.293211344 podStartE2EDuration="21.909154784s" totalImagesPullingTime="17.61594344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:08.909112204 +0000 UTC m=+22.713469728" watchObservedRunningTime="2026-09-04 22:09:08.909154784 +0000 UTC m=+22.713512308"
Sep 04 22:09:09.597416 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:09.597301    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-04T22:09:08.804515649Z","UUID":"50168829-9b6d-4a07-b671-e09ec9f51c35","Handler":null,"Name":"","Endpoint":""}
Sep 04 22:09:09.599100 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:09.599061    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 04 22:09:09.599100 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:09.599101    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 04 22:09:09.664784 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:09.664750    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:09.664784 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:09.664784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:09.665002 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:09.664860    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:09.665002 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:09.664984    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:10.665300 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:10.665274    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:10.665664 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:10.665368    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:10.898105 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:10.898066    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9" event={"ID":"9fd25bf3-5aaf-4857-848b-ffd92edb4528","Type":"ContainerStarted","Data":"b89d93521b8de2ecef3530c6eebf96f244a1c8378c77297913b217434fe9b9ea"}
Sep 04 22:09:10.902022 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:10.901985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"ef87717bb65b00fbfa194d3536cb2204dc049e984727facf67ef6a435d89ae2e"}
Sep 04 22:09:10.919888 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:10.919801    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdn9" podStartSLOduration=4.1698067 podStartE2EDuration="23.919783285s" totalImagesPullingTime="19.749976585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:10.918870311 +0000 UTC m=+24.723227834" watchObservedRunningTime="2026-09-04 22:09:10.919783285 +0000 UTC m=+24.724140812"
Sep 04 22:09:11.664520 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:11.664487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:11.664714 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:11.664488    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:11.664714 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:11.664648    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:11.664714 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:11.664686    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:12.664672 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.664489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:12.665322 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:12.664773    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:12.909034 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.909003    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0c78e1d-3a62-4d8e-b8a0-a6c673966222" containerID="69d5a9ea3a9bcffb51e68acd159a0a0059678a71e38495b68439e8b9cbcafa4e" exitCode=0
Sep 04 22:09:12.909169 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.909080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerDied","Data":"69d5a9ea3a9bcffb51e68acd159a0a0059678a71e38495b68439e8b9cbcafa4e"}
Sep 04 22:09:12.913472 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.913445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" event={"ID":"6c9d3d20-2f44-47c4-b273-d494dd0a41aa","Type":"ContainerStarted","Data":"be30a2b9ed0c934b1525b53e3446416c1c7c1beee9f13726a41e7893e701a932"}
Sep 04 22:09:12.913832 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.913812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:09:12.913911 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.913883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:09:12.942729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.942701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:09:12.957175 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:12.957141    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr" podStartSLOduration=8.348674279 podStartE2EDuration="25.957129642s" totalImagesPullingTime="17.608455363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:12.956984092 +0000 UTC m=+26.761341616" watchObservedRunningTime="2026-09-04 22:09:12.957129642 +0000 UTC m=+26.761487163"
Sep 04 22:09:13.665623 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:13.664472    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:13.665623 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:13.664853    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:13.665623 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:13.664529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:13.665623 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:13.665243    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:13.917942 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:13.917865    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0c78e1d-3a62-4d8e-b8a0-a6c673966222" containerID="ddcfd97c0bade900666921ddea24d3d8e01add2cb458202da7ec3d699d01fa0b" exitCode=0
Sep 04 22:09:13.918107 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:13.917943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerDied","Data":"ddcfd97c0bade900666921ddea24d3d8e01add2cb458202da7ec3d699d01fa0b"}
Sep 04 22:09:13.918394 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:13.918374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:09:13.932051 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:13.932036    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:09:14.383459 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.383432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zt747"]
Sep 04 22:09:14.383614 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.383558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:14.383693 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:14.383673    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:14.388018 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.387983    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m6gh8"]
Sep 04 22:09:14.388154 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.388113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:14.388244 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:14.388216    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:14.388796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.388771    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmdnh"]
Sep 04 22:09:14.388925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.388865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:14.389053 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:14.388947    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:14.921944 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.921868    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0c78e1d-3a62-4d8e-b8a0-a6c673966222" containerID="5c9f1b2606ca0a544df0065f17c8785a37788976ed14ea10ddad1e30247fb648" exitCode=0
Sep 04 22:09:14.922323 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:14.921952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerDied","Data":"5c9f1b2606ca0a544df0065f17c8785a37788976ed14ea10ddad1e30247fb648"}
Sep 04 22:09:15.664441 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:15.664409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:15.664611 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:15.664449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:15.664611 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:15.664506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:15.664611 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:15.664523    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:15.664773 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:15.664610    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:15.664773 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:15.664711    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:17.664826 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:17.664617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:17.665256 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:17.664629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:17.665256 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:17.664931    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:17.665256 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:17.664629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:17.665256 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:17.664982    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:17.665256 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:17.665077    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:19.664634 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:19.664568    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:19.664634 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:19.664587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:19.664634 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:19.664624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:19.665068 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:19.664697    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmdnh" podUID="b61480f6-0147-45a4-b154-402a2582e238"
Sep 04 22:09:19.665068 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:19.664735    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zt747" podUID="9ad471ec-b404-491c-81d9-b5fa38c02d44"
Sep 04 22:09:19.665068 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:19.664799    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m6gh8" podUID="b3f6f05c-3c83-4651-b5c8-43e643e24496"
Sep 04 22:09:19.936032 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:19.935957    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0c78e1d-3a62-4d8e-b8a0-a6c673966222" containerID="560a46d1d9d432fec3d1718075878acd01a4c38b901aab4d8eef26678ae7658a" exitCode=0
Sep 04 22:09:19.936173 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:19.936024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerDied","Data":"560a46d1d9d432fec3d1718075878acd01a4c38b901aab4d8eef26678ae7658a"}
Sep 04 22:09:20.313026 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:20.312952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:20.313270 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.313076    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 04 22:09:20.313270 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.313134    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret podName:9ad471ec-b404-491c-81d9-b5fa38c02d44 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:52.313117369 +0000 UTC m=+66.117474878 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret") pod "global-pull-secret-syncer-zt747" (UID: "9ad471ec-b404-491c-81d9-b5fa38c02d44") : object "kube-system"/"original-pull-secret" not registered
Sep 04 22:09:20.414031 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:20.414006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:20.414142 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:20.414048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:20.414184 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.414141    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:09:20.414184 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.414154    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 04 22:09:20.414184 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.414172    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 04 22:09:20.414184 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.414183    2564 projected.go:196] Error preparing data for projected volume kube-api-access-dr8kd for pod openshift-network-diagnostics/network-check-target-wmdnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:09:20.414298 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.414224    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:52.414208748 +0000 UTC m=+66.218566265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 04 22:09:20.414298 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:20.414238    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd podName:b61480f6-0147-45a4-b154-402a2582e238 nodeName:}" failed. No retries permitted until 2026-09-04 22:09:52.414232456 +0000 UTC m=+66.218589958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dr8kd" (UniqueName: "kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd") pod "network-check-target-wmdnh" (UID: "b61480f6-0147-45a4-b154-402a2582e238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 04 22:09:20.941114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:20.941084    2564 generic.go:356] "Generic (PLEG): container finished" podID="e0c78e1d-3a62-4d8e-b8a0-a6c673966222" containerID="c7a73a5e8f5cc745b6c2b79e8abf5fa9f181d395ec7b3e6512f6de9bc11e8ee2" exitCode=0
Sep 04 22:09:20.941477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:20.941156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerDied","Data":"c7a73a5e8f5cc745b6c2b79e8abf5fa9f181d395ec7b3e6512f6de9bc11e8ee2"}
Sep 04 22:09:21.011134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.010819    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-255.ec2.internal" event="NodeReady"
Sep 04 22:09:21.011134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.010956    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 04 22:09:21.063917 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.063894    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t2wsr"]
Sep 04 22:09:21.080777 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.080758    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9752r"]
Sep 04 22:09:21.080905 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.080887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.083394 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.083369    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 04 22:09:21.083691 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.083675    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 04 22:09:21.083945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.083931    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wcrtk\""
Sep 04 22:09:21.098837 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.098812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9752r"]
Sep 04 22:09:21.098929 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.098845    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t2wsr"]
Sep 04 22:09:21.098929 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.098924    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.101084 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.101063    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 04 22:09:21.101227 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.101210    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 04 22:09:21.101290 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.101267    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 04 22:09:21.101346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.101219    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-psbpz\""
Sep 04 22:09:21.219423 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.219370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.219423 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.219403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/365fa8d5-afda-473a-ae2c-9fdf8e16313b-config-volume\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.219423 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.219420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/365fa8d5-afda-473a-ae2c-9fdf8e16313b-tmp-dir\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.219588 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.219434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e18588a-0b92-41dd-ba69-4ec8ac138d4b-cert\") pod \"ingress-canary-9752r\" (UID: \"5e18588a-0b92-41dd-ba69-4ec8ac138d4b\") " pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.219588 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.219474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwvn4\" (UniqueName: \"kubernetes.io/projected/5e18588a-0b92-41dd-ba69-4ec8ac138d4b-kube-api-access-jwvn4\") pod \"ingress-canary-9752r\" (UID: \"5e18588a-0b92-41dd-ba69-4ec8ac138d4b\") " pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.219588 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.219541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8nv\" (UniqueName: \"kubernetes.io/projected/365fa8d5-afda-473a-ae2c-9fdf8e16313b-kube-api-access-gb8nv\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.320061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8nv\" (UniqueName: \"kubernetes.io/projected/365fa8d5-afda-473a-ae2c-9fdf8e16313b-kube-api-access-gb8nv\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.320140 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.320140 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/365fa8d5-afda-473a-ae2c-9fdf8e16313b-config-volume\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.320140 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/365fa8d5-afda-473a-ae2c-9fdf8e16313b-tmp-dir\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.320264 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:21.320197    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 22:09:21.320264 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e18588a-0b92-41dd-ba69-4ec8ac138d4b-cert\") pod \"ingress-canary-9752r\" (UID: \"5e18588a-0b92-41dd-ba69-4ec8ac138d4b\") " pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.320264 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:21.320253    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls podName:365fa8d5-afda-473a-ae2c-9fdf8e16313b nodeName:}" failed. No retries permitted until 2026-09-04 22:09:21.820235138 +0000 UTC m=+35.624592661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls") pod "dns-default-t2wsr" (UID: "365fa8d5-afda-473a-ae2c-9fdf8e16313b") : secret "dns-default-metrics-tls" not found
Sep 04 22:09:21.320422 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwvn4\" (UniqueName: \"kubernetes.io/projected/5e18588a-0b92-41dd-ba69-4ec8ac138d4b-kube-api-access-jwvn4\") pod \"ingress-canary-9752r\" (UID: \"5e18588a-0b92-41dd-ba69-4ec8ac138d4b\") " pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.320474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/365fa8d5-afda-473a-ae2c-9fdf8e16313b-tmp-dir\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.320640 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.320625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/365fa8d5-afda-473a-ae2c-9fdf8e16313b-config-volume\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.324205 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.324189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e18588a-0b92-41dd-ba69-4ec8ac138d4b-cert\") pod \"ingress-canary-9752r\" (UID: \"5e18588a-0b92-41dd-ba69-4ec8ac138d4b\") " pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.329044 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.329020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwvn4\" (UniqueName: \"kubernetes.io/projected/5e18588a-0b92-41dd-ba69-4ec8ac138d4b-kube-api-access-jwvn4\") pod \"ingress-canary-9752r\" (UID: \"5e18588a-0b92-41dd-ba69-4ec8ac138d4b\") " pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.329122 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.329046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8nv\" (UniqueName: \"kubernetes.io/projected/365fa8d5-afda-473a-ae2c-9fdf8e16313b-kube-api-access-gb8nv\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.406149 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.406126    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9752r"
Sep 04 22:09:21.664616 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.664457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:21.664748 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.664515    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:21.664814 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.664515    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:21.667199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.667180    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 04 22:09:21.667799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.667776    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 04 22:09:21.667898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.667812    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 04 22:09:21.667898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.667827    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 04 22:09:21.667898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.667885    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5pc9f\""
Sep 04 22:09:21.668049 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.667890    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c64pf\""
Sep 04 22:09:21.720758 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.720739    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9752r"]
Sep 04 22:09:21.723525 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:09:21.723503    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e18588a_0b92_41dd_ba69_4ec8ac138d4b.slice/crio-57a7d2f2222535bb22be0208a861b7f28fe44f5ed273dc69f933ee4d705807e8 WatchSource:0}: Error finding container 57a7d2f2222535bb22be0208a861b7f28fe44f5ed273dc69f933ee4d705807e8: Status 404 returned error can't find the container with id 57a7d2f2222535bb22be0208a861b7f28fe44f5ed273dc69f933ee4d705807e8
Sep 04 22:09:21.823554 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.823534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:21.823721 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:21.823704    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 22:09:21.823791 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:21.823770    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls podName:365fa8d5-afda-473a-ae2c-9fdf8e16313b nodeName:}" failed. No retries permitted until 2026-09-04 22:09:22.823750217 +0000 UTC m=+36.628107726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls") pod "dns-default-t2wsr" (UID: "365fa8d5-afda-473a-ae2c-9fdf8e16313b") : secret "dns-default-metrics-tls" not found
Sep 04 22:09:21.944352 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.944327    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9752r" event={"ID":"5e18588a-0b92-41dd-ba69-4ec8ac138d4b","Type":"ContainerStarted","Data":"57a7d2f2222535bb22be0208a861b7f28fe44f5ed273dc69f933ee4d705807e8"}
Sep 04 22:09:21.947468 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.947446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" event={"ID":"e0c78e1d-3a62-4d8e-b8a0-a6c673966222","Type":"ContainerStarted","Data":"0701b35e72a97f0256834f91ef72fbc3fc7950303621fbe444f1d96ffb3847d5"}
Sep 04 22:09:21.969773 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:21.969738    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sjwpx" podStartSLOduration=7.186880638 podStartE2EDuration="34.969725588s" totalImagesPullingTime="27.78284495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:21.969284178 +0000 UTC m=+35.773641703" watchObservedRunningTime="2026-09-04 22:09:21.969725588 +0000 UTC m=+35.774083104"
Sep 04 22:09:22.830667 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:22.830637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:22.830832 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:22.830752    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 22:09:22.830832 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:22.830809    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls podName:365fa8d5-afda-473a-ae2c-9fdf8e16313b nodeName:}" failed. No retries permitted until 2026-09-04 22:09:24.83079273 +0000 UTC m=+38.635150232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls") pod "dns-default-t2wsr" (UID: "365fa8d5-afda-473a-ae2c-9fdf8e16313b") : secret "dns-default-metrics-tls" not found
Sep 04 22:09:24.843722 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:24.843692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:24.844078 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:24.843801    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 22:09:24.844078 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:24.843861    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls podName:365fa8d5-afda-473a-ae2c-9fdf8e16313b nodeName:}" failed. No retries permitted until 2026-09-04 22:09:28.843848151 +0000 UTC m=+42.648205684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls") pod "dns-default-t2wsr" (UID: "365fa8d5-afda-473a-ae2c-9fdf8e16313b") : secret "dns-default-metrics-tls" not found
Sep 04 22:09:24.954912 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:24.954880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9752r" event={"ID":"5e18588a-0b92-41dd-ba69-4ec8ac138d4b","Type":"ContainerStarted","Data":"84f613a801e4877dd132588bfb93ff6dc60638ef5d778df4b345ea83182945fb"}
Sep 04 22:09:28.868079 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:28.868034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:28.868524 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:28.868160    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 22:09:28.868524 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:28.868229    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls podName:365fa8d5-afda-473a-ae2c-9fdf8e16313b nodeName:}" failed. No retries permitted until 2026-09-04 22:09:36.868208422 +0000 UTC m=+50.672565939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls") pod "dns-default-t2wsr" (UID: "365fa8d5-afda-473a-ae2c-9fdf8e16313b") : secret "dns-default-metrics-tls" not found
Sep 04 22:09:36.921898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:36.921865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:36.922303 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:36.922004    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 22:09:36.922303 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:36.922100    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls podName:365fa8d5-afda-473a-ae2c-9fdf8e16313b nodeName:}" failed. No retries permitted until 2026-09-04 22:09:52.922080713 +0000 UTC m=+66.726438215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls") pod "dns-default-t2wsr" (UID: "365fa8d5-afda-473a-ae2c-9fdf8e16313b") : secret "dns-default-metrics-tls" not found
Sep 04 22:09:45.934678 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:45.934651    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mbkr"
Sep 04 22:09:45.975817 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:45.975771    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9752r" podStartSLOduration=22.59192623 podStartE2EDuration="24.975757319s" totalImagesPullingTime="2.383831089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:24.974305435 +0000 UTC m=+38.778662959" watchObservedRunningTime="2026-09-04 22:09:45.975757319 +0000 UTC m=+59.780114859"
Sep 04 22:09:52.317385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.317335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:52.319993 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.319973    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 04 22:09:52.331146 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.331125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ad471ec-b404-491c-81d9-b5fa38c02d44-original-pull-secret\") pod \"global-pull-secret-syncer-zt747\" (UID: \"9ad471ec-b404-491c-81d9-b5fa38c02d44\") " pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:52.418489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.418457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:52.418619 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.418508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:09:52.421185 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.421167    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 04 22:09:52.421357 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.421346    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 04 22:09:52.429029 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:52.429014    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 04 22:09:52.429079 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:52.429070    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs podName:b3f6f05c-3c83-4651-b5c8-43e643e24496 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:56.429055275 +0000 UTC m=+130.233412778 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs") pod "network-metrics-daemon-m6gh8" (UID: "b3f6f05c-3c83-4651-b5c8-43e643e24496") : secret "metrics-daemon-secret" not found
Sep 04 22:09:52.430668 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.430654    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 04 22:09:52.441419 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.441394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr8kd\" (UniqueName: \"kubernetes.io/projected/b61480f6-0147-45a4-b154-402a2582e238-kube-api-access-dr8kd\") pod \"network-check-target-wmdnh\" (UID: \"b61480f6-0147-45a4-b154-402a2582e238\") " pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:52.578146 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.578089    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5pc9f\""
Sep 04 22:09:52.580834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.580821    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zt747"
Sep 04 22:09:52.586235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.586217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:52.850477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.850409    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zt747"]
Sep 04 22:09:52.853826 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.853794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmdnh"]
Sep 04 22:09:52.854134 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:09:52.854114    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad471ec_b404_491c_81d9_b5fa38c02d44.slice/crio-e348601ea41f5a6acd93a6617551b8acc603d16475459f33e9cb47b829e2a81d WatchSource:0}: Error finding container e348601ea41f5a6acd93a6617551b8acc603d16475459f33e9cb47b829e2a81d: Status 404 returned error can't find the container with id e348601ea41f5a6acd93a6617551b8acc603d16475459f33e9cb47b829e2a81d
Sep 04 22:09:52.857357 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:09:52.857330    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61480f6_0147_45a4_b154_402a2582e238.slice/crio-0ea6a252b08d1004306b0d99c90c4964fdfb19a5fdce25ff898ca9bfd350230b WatchSource:0}: Error finding container 0ea6a252b08d1004306b0d99c90c4964fdfb19a5fdce25ff898ca9bfd350230b: Status 404 returned error can't find the container with id 0ea6a252b08d1004306b0d99c90c4964fdfb19a5fdce25ff898ca9bfd350230b
Sep 04 22:09:52.923040 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:52.923018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:09:52.923154 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:52.923142    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 04 22:09:52.923193 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:09:52.923188    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls podName:365fa8d5-afda-473a-ae2c-9fdf8e16313b nodeName:}" failed. No retries permitted until 2026-09-04 22:10:24.923174318 +0000 UTC m=+98.727531820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls") pod "dns-default-t2wsr" (UID: "365fa8d5-afda-473a-ae2c-9fdf8e16313b") : secret "dns-default-metrics-tls" not found
Sep 04 22:09:53.016611 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:53.016569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmdnh" event={"ID":"b61480f6-0147-45a4-b154-402a2582e238","Type":"ContainerStarted","Data":"0ea6a252b08d1004306b0d99c90c4964fdfb19a5fdce25ff898ca9bfd350230b"}
Sep 04 22:09:53.017705 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:53.017681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zt747" event={"ID":"9ad471ec-b404-491c-81d9-b5fa38c02d44","Type":"ContainerStarted","Data":"e348601ea41f5a6acd93a6617551b8acc603d16475459f33e9cb47b829e2a81d"}
Sep 04 22:09:58.032112 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:58.032071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zt747" event={"ID":"9ad471ec-b404-491c-81d9-b5fa38c02d44","Type":"ContainerStarted","Data":"49dcbb92802cca9f9001c00f6148d34e3766e929c99d6a20bd334a7f970a1fcf"}
Sep 04 22:09:58.033558 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:58.033530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmdnh" event={"ID":"b61480f6-0147-45a4-b154-402a2582e238","Type":"ContainerStarted","Data":"f4d9214d0dd00ee2c7283ec78cf61cdc14bde5a8d1d3be9dedac697aeccf6d88"}
Sep 04 22:09:58.033701 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:58.033636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:09:58.049127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:58.049080    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zt747" podStartSLOduration=66.646213338 podStartE2EDuration="1m11.049065577s" totalImagesPullingTime="4.402852239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:58.048466305 +0000 UTC m=+71.852823829" watchObservedRunningTime="2026-09-04 22:09:58.049065577 +0000 UTC m=+71.853423124"
Sep 04 22:09:58.065613 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:09:58.065563    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wmdnh" podStartSLOduration=66.667460288 podStartE2EDuration="1m11.065551415s" totalImagesPullingTime="4.398091127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:09:58.065312955 +0000 UTC m=+71.869670478" watchObservedRunningTime="2026-09-04 22:09:58.065551415 +0000 UTC m=+71.869908941"
Sep 04 22:10:00.377788 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.377749    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"]
Sep 04 22:10:00.380779 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.380761    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"]
Sep 04 22:10:00.380905 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.380888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"
Sep 04 22:10:00.383788 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.383766    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 04 22:10:00.383874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.383809    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8sjzv\""
Sep 04 22:10:00.383874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.383829    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:00.383874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.383849    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 04 22:10:00.386363 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.386341    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 04 22:10:00.386466 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.386424    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 04 22:10:00.386543 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.386514    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bxx5w\""
Sep 04 22:10:00.386626 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.386578    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 04 22:10:00.401283 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.401251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"]
Sep 04 22:10:00.402131 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.402113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"]
Sep 04 22:10:00.472679 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.472653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8df\" (UniqueName: \"kubernetes.io/projected/27efcf9b-413a-4f08-b5b0-f898cd6ed2c8-kube-api-access-4t8df\") pod \"volume-data-source-validator-695c895bd6-2cvvv\" (UID: \"27efcf9b-413a-4f08-b5b0-f898cd6ed2c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"
Sep 04 22:10:00.472802 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.472695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twsc\" (UniqueName: \"kubernetes.io/projected/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-kube-api-access-4twsc\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:00.472802 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.472729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:00.573164 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.573143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:00.573266 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.573180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t8df\" (UniqueName: \"kubernetes.io/projected/27efcf9b-413a-4f08-b5b0-f898cd6ed2c8-kube-api-access-4t8df\") pod \"volume-data-source-validator-695c895bd6-2cvvv\" (UID: \"27efcf9b-413a-4f08-b5b0-f898cd6ed2c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"
Sep 04 22:10:00.573266 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.573209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twsc\" (UniqueName: \"kubernetes.io/projected/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-kube-api-access-4twsc\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:00.573375 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:00.573303    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 22:10:00.573425 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:00.573375    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls podName:dc78dc6d-a368-44f8-9fe4-b228ad973a9e nodeName:}" failed. No retries permitted until 2026-09-04 22:10:01.073355705 +0000 UTC m=+74.877713222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8d48j" (UID: "dc78dc6d-a368-44f8-9fe4-b228ad973a9e") : secret "samples-operator-tls" not found
Sep 04 22:10:00.582375 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.582357    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twsc\" (UniqueName: \"kubernetes.io/projected/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-kube-api-access-4twsc\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:00.582451 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.582392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t8df\" (UniqueName: \"kubernetes.io/projected/27efcf9b-413a-4f08-b5b0-f898cd6ed2c8-kube-api-access-4t8df\") pod \"volume-data-source-validator-695c895bd6-2cvvv\" (UID: \"27efcf9b-413a-4f08-b5b0-f898cd6ed2c8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"
Sep 04 22:10:00.690655 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.690593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"
Sep 04 22:10:00.958348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:00.958281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv"]
Sep 04 22:10:00.961596 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:00.961574    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27efcf9b_413a_4f08_b5b0_f898cd6ed2c8.slice/crio-d8c7d8c42594f5287faee9b3c9cddb7346af917027028124d912b90eac71b8a5 WatchSource:0}: Error finding container d8c7d8c42594f5287faee9b3c9cddb7346af917027028124d912b90eac71b8a5: Status 404 returned error can't find the container with id d8c7d8c42594f5287faee9b3c9cddb7346af917027028124d912b90eac71b8a5
Sep 04 22:10:01.042514 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:01.042483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv" event={"ID":"27efcf9b-413a-4f08-b5b0-f898cd6ed2c8","Type":"ContainerStarted","Data":"d8c7d8c42594f5287faee9b3c9cddb7346af917027028124d912b90eac71b8a5"}
Sep 04 22:10:01.075887 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:01.075862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:01.076030 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:01.076011    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 22:10:01.076086 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:01.076077    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls podName:dc78dc6d-a368-44f8-9fe4-b228ad973a9e nodeName:}" failed. No retries permitted until 2026-09-04 22:10:02.076056506 +0000 UTC m=+75.880414019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8d48j" (UID: "dc78dc6d-a368-44f8-9fe4-b228ad973a9e") : secret "samples-operator-tls" not found
Sep 04 22:10:02.083210 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:02.083178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:02.083584 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:02.083333    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 22:10:02.083584 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:02.083424    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls podName:dc78dc6d-a368-44f8-9fe4-b228ad973a9e nodeName:}" failed. No retries permitted until 2026-09-04 22:10:04.083409332 +0000 UTC m=+77.887766834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8d48j" (UID: "dc78dc6d-a368-44f8-9fe4-b228ad973a9e") : secret "samples-operator-tls" not found
Sep 04 22:10:03.052129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:03.052091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv" event={"ID":"27efcf9b-413a-4f08-b5b0-f898cd6ed2c8","Type":"ContainerStarted","Data":"a75ff2421562a4bf0ecefdaba2606d32b4eb1a29e38d6bb3e18470a9e534c510"}
Sep 04 22:10:03.069586 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:03.069540    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cvvv" podStartSLOduration=1.7872462759999999 podStartE2EDuration="3.069526835s" totalImagesPullingTime="1.282280559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:03.069489141 +0000 UTC m=+76.873846667" watchObservedRunningTime="2026-09-04 22:10:03.069526835 +0000 UTC m=+76.873884393"
Sep 04 22:10:04.097419 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.097391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:04.097857 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:04.097536    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 22:10:04.097857 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:04.097593    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls podName:dc78dc6d-a368-44f8-9fe4-b228ad973a9e nodeName:}" failed. No retries permitted until 2026-09-04 22:10:08.097578648 +0000 UTC m=+81.901936150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8d48j" (UID: "dc78dc6d-a368-44f8-9fe4-b228ad973a9e") : secret "samples-operator-tls" not found
Sep 04 22:10:04.327212 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.327181    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-plhrr"]
Sep 04 22:10:04.330271 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.330255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.332241 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.332220    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 04 22:10:04.332665 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.332630    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 04 22:10:04.332768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.332719    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fhpsq\""
Sep 04 22:10:04.333065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.333043    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 04 22:10:04.333147 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.333099    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 04 22:10:04.340493 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.340473    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-plhrr"]
Sep 04 22:10:04.399007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.398962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91c83992-9df0-4630-b125-0ad6c9166b44-crio-socket\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.399007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.399001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91c83992-9df0-4630-b125-0ad6c9166b44-data-volume\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.399124 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.399034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.399124 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.399060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.399124 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.399084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9sbx\" (UniqueName: \"kubernetes.io/projected/91c83992-9df0-4630-b125-0ad6c9166b44-kube-api-access-t9sbx\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.499372 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.499347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91c83992-9df0-4630-b125-0ad6c9166b44-data-volume\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.499440 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.499386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.499440 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.499404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.499509 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:04.499469    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 22:10:04.499509 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:04.499487    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:04.499587 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:04.499529    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:04.999515258 +0000 UTC m=+78.803872805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : configmap "kube-rbac-proxy" not found
Sep 04 22:10:04.499587 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.499544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9sbx\" (UniqueName: \"kubernetes.io/projected/91c83992-9df0-4630-b125-0ad6c9166b44-kube-api-access-t9sbx\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.499587 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.499583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91c83992-9df0-4630-b125-0ad6c9166b44-crio-socket\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.499766 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:04.499621    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:04.999586911 +0000 UTC m=+78.803944415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:04.499766 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.499646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91c83992-9df0-4630-b125-0ad6c9166b44-crio-socket\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.499766 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.499674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91c83992-9df0-4630-b125-0ad6c9166b44-data-volume\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:04.510888 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:04.510871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9sbx\" (UniqueName: \"kubernetes.io/projected/91c83992-9df0-4630-b125-0ad6c9166b44-kube-api-access-t9sbx\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:05.002589 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.002552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:05.002589 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.002594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:05.002828 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:05.002675    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 22:10:05.002828 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:05.002693    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:05.002828 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:05.002741    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:06.002728711 +0000 UTC m=+79.807086213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:05.002828 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:05.002755    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:06.002749196 +0000 UTC m=+79.807106697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : configmap "kube-rbac-proxy" not found
Sep 04 22:10:05.199246 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.199218    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"]
Sep 04 22:10:05.202216 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.202201    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.204271 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.204249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 04 22:10:05.204495 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.204479    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 04 22:10:05.205152 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.205136    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 04 22:10:05.205233 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.205169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dx6np\""
Sep 04 22:10:05.205293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.205267    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 04 22:10:05.211727 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.211705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"]
Sep 04 22:10:05.305585 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.305516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6x9f\" (UniqueName: \"kubernetes.io/projected/e5a791a7-0a61-4501-b0c5-3789ffca6261-kube-api-access-t6x9f\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.305715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.305586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5a791a7-0a61-4501-b0c5-3789ffca6261-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.305715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.305680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5a791a7-0a61-4501-b0c5-3789ffca6261-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.406483 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.406440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5a791a7-0a61-4501-b0c5-3789ffca6261-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.406483 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.406492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6x9f\" (UniqueName: \"kubernetes.io/projected/e5a791a7-0a61-4501-b0c5-3789ffca6261-kube-api-access-t6x9f\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.406706 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.406542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5a791a7-0a61-4501-b0c5-3789ffca6261-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.406995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.406975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5a791a7-0a61-4501-b0c5-3789ffca6261-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.408644 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.408613    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5a791a7-0a61-4501-b0c5-3789ffca6261-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.424697 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.424675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6x9f\" (UniqueName: \"kubernetes.io/projected/e5a791a7-0a61-4501-b0c5-3789ffca6261-kube-api-access-t6x9f\") pod \"kube-storage-version-migrator-operator-8d7dd4675-7zl8s\" (UID: \"e5a791a7-0a61-4501-b0c5-3789ffca6261\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.511819 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.511793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"
Sep 04 22:10:05.785330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:05.783663    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s"]
Sep 04 22:10:05.787619 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:05.787567    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a791a7_0a61_4501_b0c5_3789ffca6261.slice/crio-a0478d2b09ce96251a930a58634fcec28f001ccf58654f677948c7fade46eae2 WatchSource:0}: Error finding container a0478d2b09ce96251a930a58634fcec28f001ccf58654f677948c7fade46eae2: Status 404 returned error can't find the container with id a0478d2b09ce96251a930a58634fcec28f001ccf58654f677948c7fade46eae2
Sep 04 22:10:06.010332 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:06.010298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:06.010478 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:06.010339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:06.010478 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:06.010411    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 22:10:06.010478 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:06.010430    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:06.010478 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:06.010464    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:08.010450139 +0000 UTC m=+81.814807674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : configmap "kube-rbac-proxy" not found
Sep 04 22:10:06.010478 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:06.010478    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:08.010471953 +0000 UTC m=+81.814829456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:06.060387 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:06.060363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s" event={"ID":"e5a791a7-0a61-4501-b0c5-3789ffca6261","Type":"ContainerStarted","Data":"a0478d2b09ce96251a930a58634fcec28f001ccf58654f677948c7fade46eae2"}
Sep 04 22:10:06.271192 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:06.271125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ngj8_55666064-c8a5-4d05-9b9c-b255bc3b0d4a/dns-node-resolver/0.log"
Sep 04 22:10:07.271579 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:07.271550    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-drdhf_0fcb5d90-7077-4d96-aa70-ff55659d199b/node-ca/0.log"
Sep 04 22:10:08.026170 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.026093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:08.026170 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.026129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:08.026338 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:08.026222    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 22:10:08.026338 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:08.026240    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:08.026338 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:08.026288    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:12.026271899 +0000 UTC m=+85.830629400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : configmap "kube-rbac-proxy" not found
Sep 04 22:10:08.026338 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:08.026303    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:12.02629664 +0000 UTC m=+85.830654142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:08.067009 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.066980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s" event={"ID":"e5a791a7-0a61-4501-b0c5-3789ffca6261","Type":"ContainerStarted","Data":"da3f19d548293e262948951629d1d4689ac0d1825a67cd6fd079caa8cb6f87ee"}
Sep 04 22:10:08.072381 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.072356    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9752r_5e18588a-0b92-41dd-ba69-4ec8ac138d4b/serve-healthcheck-canary/0.log"
Sep 04 22:10:08.091248 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.091205    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s" podStartSLOduration=1.270587786 podStartE2EDuration="3.091191302s" totalImagesPullingTime="1.820603516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:08.089936067 +0000 UTC m=+81.894293591" watchObservedRunningTime="2026-09-04 22:10:08.091191302 +0000 UTC m=+81.895548825"
Sep 04 22:10:08.126946 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.126906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:08.127100 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:08.127043    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 22:10:08.127168 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:08.127109    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls podName:dc78dc6d-a368-44f8-9fe4-b228ad973a9e nodeName:}" failed. No retries permitted until 2026-09-04 22:10:16.127091775 +0000 UTC m=+89.931449298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8d48j" (UID: "dc78dc6d-a368-44f8-9fe4-b228ad973a9e") : secret "samples-operator-tls" not found
Sep 04 22:10:08.189143 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.189110    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"]
Sep 04 22:10:08.192208 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.192193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.194762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.194696    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 04 22:10:08.194762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.194735    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z8f5w\""
Sep 04 22:10:08.194762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.194751    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 04 22:10:08.194762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.194762    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 04 22:10:08.195021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.194753    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 04 22:10:08.204872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.204851    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"]
Sep 04 22:10:08.227721 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.227690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52e42ee9-0bbb-4be6-b270-427a235d069d-config\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.227833 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.227755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52e42ee9-0bbb-4be6-b270-427a235d069d-serving-cert\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.227833 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.227814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzch9\" (UniqueName: \"kubernetes.io/projected/52e42ee9-0bbb-4be6-b270-427a235d069d-kube-api-access-wzch9\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.328910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.328871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzch9\" (UniqueName: \"kubernetes.io/projected/52e42ee9-0bbb-4be6-b270-427a235d069d-kube-api-access-wzch9\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.329377 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.328954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52e42ee9-0bbb-4be6-b270-427a235d069d-config\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.329377 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.328990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52e42ee9-0bbb-4be6-b270-427a235d069d-serving-cert\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.329523 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.329505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52e42ee9-0bbb-4be6-b270-427a235d069d-config\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.331184 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.331165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52e42ee9-0bbb-4be6-b270-427a235d069d-serving-cert\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.341022 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.340998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzch9\" (UniqueName: \"kubernetes.io/projected/52e42ee9-0bbb-4be6-b270-427a235d069d-kube-api-access-wzch9\") pod \"service-ca-operator-859f94c4b-vnfrv\" (UID: \"52e42ee9-0bbb-4be6-b270-427a235d069d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.502566 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.502532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"
Sep 04 22:10:08.774513 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:08.774418    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv"]
Sep 04 22:10:08.776876 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:08.776851    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e42ee9_0bbb_4be6_b270_427a235d069d.slice/crio-98fa17847275a0fe0a709063323b98971a9d9851778d31480a62c21332189d38 WatchSource:0}: Error finding container 98fa17847275a0fe0a709063323b98971a9d9851778d31480a62c21332189d38: Status 404 returned error can't find the container with id 98fa17847275a0fe0a709063323b98971a9d9851778d31480a62c21332189d38
Sep 04 22:10:09.070955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.070927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv" event={"ID":"52e42ee9-0bbb-4be6-b270-427a235d069d","Type":"ContainerStarted","Data":"98fa17847275a0fe0a709063323b98971a9d9851778d31480a62c21332189d38"}
Sep 04 22:10:09.893664 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.893631    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"]
Sep 04 22:10:09.896662 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.896646    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"
Sep 04 22:10:09.899016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.898992    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 04 22:10:09.899650 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.899629    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 04 22:10:09.899743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.899629    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-c2z5b\""
Sep 04 22:10:09.904677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.904656    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"]
Sep 04 22:10:09.943085 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:09.943062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plndr\" (UniqueName: \"kubernetes.io/projected/8debe23c-27d9-41cb-b13a-e7f00f98fa28-kube-api-access-plndr\") pod \"migrator-fdbb8fdff-h56wv\" (UID: \"8debe23c-27d9-41cb-b13a-e7f00f98fa28\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"
Sep 04 22:10:10.044299 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:10.044267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plndr\" (UniqueName: \"kubernetes.io/projected/8debe23c-27d9-41cb-b13a-e7f00f98fa28-kube-api-access-plndr\") pod \"migrator-fdbb8fdff-h56wv\" (UID: \"8debe23c-27d9-41cb-b13a-e7f00f98fa28\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"
Sep 04 22:10:10.053683 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:10.053660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plndr\" (UniqueName: \"kubernetes.io/projected/8debe23c-27d9-41cb-b13a-e7f00f98fa28-kube-api-access-plndr\") pod \"migrator-fdbb8fdff-h56wv\" (UID: \"8debe23c-27d9-41cb-b13a-e7f00f98fa28\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"
Sep 04 22:10:10.206270 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:10.206186    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"
Sep 04 22:10:10.479074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:10.478997    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv"]
Sep 04 22:10:10.727225 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:10.727194    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8debe23c_27d9_41cb_b13a_e7f00f98fa28.slice/crio-924aa509f02f5b7b43fa0b9a5a6fe19790256215cd9068f144448774f0a604a2 WatchSource:0}: Error finding container 924aa509f02f5b7b43fa0b9a5a6fe19790256215cd9068f144448774f0a604a2: Status 404 returned error can't find the container with id 924aa509f02f5b7b43fa0b9a5a6fe19790256215cd9068f144448774f0a604a2
Sep 04 22:10:11.079378 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:11.079344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv" event={"ID":"8debe23c-27d9-41cb-b13a-e7f00f98fa28","Type":"ContainerStarted","Data":"924aa509f02f5b7b43fa0b9a5a6fe19790256215cd9068f144448774f0a604a2"}
Sep 04 22:10:11.080835 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:11.080810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv" event={"ID":"52e42ee9-0bbb-4be6-b270-427a235d069d","Type":"ContainerStarted","Data":"de95b283baafe83b162a4288320256e3924d5f030655bf64b664172bf929d543"}
Sep 04 22:10:11.101284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:11.101248    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv" podStartSLOduration=1.101569015 podStartE2EDuration="3.101234741s" totalImagesPullingTime="1.999665726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:11.100663583 +0000 UTC m=+84.905021106" watchObservedRunningTime="2026-09-04 22:10:11.101234741 +0000 UTC m=+84.905592264"
Sep 04 22:10:12.060272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:12.060241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:12.060449 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:12.060278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:12.060449 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:12.060371    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 04 22:10:12.060449 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:12.060440    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:12.060634 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:12.060444    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:20.060424615 +0000 UTC m=+93.864782130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : configmap "kube-rbac-proxy" not found
Sep 04 22:10:12.060634 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:12.060488    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:20.060476584 +0000 UTC m=+93.864834086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:12.085817 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:12.085780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv" event={"ID":"8debe23c-27d9-41cb-b13a-e7f00f98fa28","Type":"ContainerStarted","Data":"20d33d7658b3b1aad525607604de69d1c4ed11eee1f3434d454533945f4ceb54"}
Sep 04 22:10:12.086182 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:12.085841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv" event={"ID":"8debe23c-27d9-41cb-b13a-e7f00f98fa28","Type":"ContainerStarted","Data":"196a45685dd35cf91ee4aa631159a2f79cee2039fa2f55b08a726ac8569fc6e8"}
Sep 04 22:10:12.104035 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:12.103991    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-h56wv" podStartSLOduration=1.947402525 podStartE2EDuration="3.103976666s" totalImagesPullingTime="1.156574141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:12.10316534 +0000 UTC m=+85.907522865" watchObservedRunningTime="2026-09-04 22:10:12.103976666 +0000 UTC m=+85.908334191"
Sep 04 22:10:16.192615 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:16.192562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:16.193016 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:16.192684    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 04 22:10:16.193016 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:16.192739    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls podName:dc78dc6d-a368-44f8-9fe4-b228ad973a9e nodeName:}" failed. No retries permitted until 2026-09-04 22:10:32.192724635 +0000 UTC m=+105.997082167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8d48j" (UID: "dc78dc6d-a368-44f8-9fe4-b228ad973a9e") : secret "samples-operator-tls" not found
Sep 04 22:10:20.120041 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:20.120008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:20.120041 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:20.120040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:20.120567 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:20.120149    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:20.120567 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:10:20.120208    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls podName:91c83992-9df0-4630-b125-0ad6c9166b44 nodeName:}" failed. No retries permitted until 2026-09-04 22:10:36.120195665 +0000 UTC m=+109.924553179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-plhrr" (UID: "91c83992-9df0-4630-b125-0ad6c9166b44") : secret "insights-runtime-extractor-tls" not found
Sep 04 22:10:20.120567 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:20.120498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91c83992-9df0-4630-b125-0ad6c9166b44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:24.956114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:24.956083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:10:24.958261 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:24.958232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/365fa8d5-afda-473a-ae2c-9fdf8e16313b-metrics-tls\") pod \"dns-default-t2wsr\" (UID: \"365fa8d5-afda-473a-ae2c-9fdf8e16313b\") " pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:10:24.994889 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:24.994868    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wcrtk\""
Sep 04 22:10:25.002871 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:25.002856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:10:25.273735 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:25.273656    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t2wsr"]
Sep 04 22:10:25.277536 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:25.277510    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365fa8d5_afda_473a_ae2c_9fdf8e16313b.slice/crio-cd358c93644e470ea3e8d718f188a8c8850ceff960d1ca437bacf36736cbe1a0 WatchSource:0}: Error finding container cd358c93644e470ea3e8d718f188a8c8850ceff960d1ca437bacf36736cbe1a0: Status 404 returned error can't find the container with id cd358c93644e470ea3e8d718f188a8c8850ceff960d1ca437bacf36736cbe1a0
Sep 04 22:10:26.129380 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:26.129346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2wsr" event={"ID":"365fa8d5-afda-473a-ae2c-9fdf8e16313b","Type":"ContainerStarted","Data":"cd358c93644e470ea3e8d718f188a8c8850ceff960d1ca437bacf36736cbe1a0"}
Sep 04 22:10:27.134535 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:27.134508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2wsr" event={"ID":"365fa8d5-afda-473a-ae2c-9fdf8e16313b","Type":"ContainerStarted","Data":"a5aff1424e146b294c59131920b9591b06ad7f2a6afe5af82682c3689691f504"}
Sep 04 22:10:28.139769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:28.139731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2wsr" event={"ID":"365fa8d5-afda-473a-ae2c-9fdf8e16313b","Type":"ContainerStarted","Data":"0cfd1c204bf37bfa1e4704053b7ec33604fbf65ac4b55d38689803639e10421d"}
Sep 04 22:10:28.140168 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:28.139873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:10:28.158467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:28.158425    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t2wsr" podStartSLOduration=65.451510621 podStartE2EDuration="1m7.158411821s" totalImagesPullingTime="1.7069012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:28.158062566 +0000 UTC m=+101.962420092" watchObservedRunningTime="2026-09-04 22:10:28.158411821 +0000 UTC m=+101.962769345"
Sep 04 22:10:29.038837 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:29.038807    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wmdnh"
Sep 04 22:10:32.209357 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:32.209327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:32.211607 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:32.211579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc78dc6d-a368-44f8-9fe4-b228ad973a9e-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8d48j\" (UID: \"dc78dc6d-a368-44f8-9fe4-b228ad973a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:32.494960 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:32.494882    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"
Sep 04 22:10:32.770798 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:32.770725    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j"]
Sep 04 22:10:33.159943 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:33.159909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j" event={"ID":"dc78dc6d-a368-44f8-9fe4-b228ad973a9e","Type":"ContainerStarted","Data":"594e25ec96f39eda45b173c841aead780c5cf6d3504142502a44f65dec2a5285"}
Sep 04 22:10:35.089494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.087532    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"]
Sep 04 22:10:35.093621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.090570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.093621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.093562    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 04 22:10:35.096793 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.095765    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gx48m\""
Sep 04 22:10:35.096793 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.096023    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 04 22:10:35.096793 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.096232    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 04 22:10:35.096793 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.096399    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 04 22:10:35.100405 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.100382    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"]
Sep 04 22:10:35.168230 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.168198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j" event={"ID":"dc78dc6d-a368-44f8-9fe4-b228ad973a9e","Type":"ContainerStarted","Data":"2027fd0b370440ffc54b623edd2825a11acc73061df148d2dd23fb3ec941208c"}
Sep 04 22:10:35.168383 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.168243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j" event={"ID":"dc78dc6d-a368-44f8-9fe4-b228ad973a9e","Type":"ContainerStarted","Data":"240cad5e07b13feaa231ea48e911b46efd9114ba93aef9bc6de0096f8c4d3997"}
Sep 04 22:10:35.196345 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.196315    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7765ddb8dd-cpng4"]
Sep 04 22:10:35.198838 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.198819    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.203103 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.203080    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 04 22:10:35.203205 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.203193    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2bk2j\""
Sep 04 22:10:35.203267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.203201    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 04 22:10:35.203320 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.203275    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 04 22:10:35.205860 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.205824    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8d48j" podStartSLOduration=33.45919377 podStartE2EDuration="35.205812384s" totalImagesPullingTime="1.746618614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:35.205689859 +0000 UTC m=+109.010047384" watchObservedRunningTime="2026-09-04 22:10:35.205812384 +0000 UTC m=+109.010169901"
Sep 04 22:10:35.207621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.207585    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 04 22:10:35.215988 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.215969    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7765ddb8dd-cpng4"]
Sep 04 22:10:35.228653 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.228623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7032c21f-a95a-4622-94eb-3fb98390ae01-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-869d4cb58-bpzjk\" (UID: \"7032c21f-a95a-4622-94eb-3fb98390ae01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.228739 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.228659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98zc\" (UniqueName: \"kubernetes.io/projected/7032c21f-a95a-4622-94eb-3fb98390ae01-kube-api-access-w98zc\") pod \"managed-serviceaccount-addon-agent-869d4cb58-bpzjk\" (UID: \"7032c21f-a95a-4622-94eb-3fb98390ae01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.329865 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.329839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98zc\" (UniqueName: \"kubernetes.io/projected/7032c21f-a95a-4622-94eb-3fb98390ae01-kube-api-access-w98zc\") pod \"managed-serviceaccount-addon-agent-869d4cb58-bpzjk\" (UID: \"7032c21f-a95a-4622-94eb-3fb98390ae01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.330020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.329871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c202b06-f1b8-4708-8247-2b11afb29a88-registry-certificates\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.330020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.329895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-registry-tls\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.330020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.329914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdl2v\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-kube-api-access-bdl2v\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.330020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.329972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c202b06-f1b8-4708-8247-2b11afb29a88-trusted-ca\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.330020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.329997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-bound-sa-token\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.330199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.330018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c202b06-f1b8-4708-8247-2b11afb29a88-installation-pull-secrets\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.330199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.330118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7032c21f-a95a-4622-94eb-3fb98390ae01-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-869d4cb58-bpzjk\" (UID: \"7032c21f-a95a-4622-94eb-3fb98390ae01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.330199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.330159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c202b06-f1b8-4708-8247-2b11afb29a88-image-registry-private-configuration\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.330319 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.330219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c202b06-f1b8-4708-8247-2b11afb29a88-ca-trust-extracted\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.332449 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.332427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7032c21f-a95a-4622-94eb-3fb98390ae01-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-869d4cb58-bpzjk\" (UID: \"7032c21f-a95a-4622-94eb-3fb98390ae01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.338965 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.338946    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98zc\" (UniqueName: \"kubernetes.io/projected/7032c21f-a95a-4622-94eb-3fb98390ae01-kube-api-access-w98zc\") pod \"managed-serviceaccount-addon-agent-869d4cb58-bpzjk\" (UID: \"7032c21f-a95a-4622-94eb-3fb98390ae01\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.414108 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.414041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"
Sep 04 22:10:35.430836 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.430804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c202b06-f1b8-4708-8247-2b11afb29a88-registry-certificates\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.430927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.430843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-registry-tls\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.430927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.430866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdl2v\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-kube-api-access-bdl2v\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.430927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.430905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c202b06-f1b8-4708-8247-2b11afb29a88-trusted-ca\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.430927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.430923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-bound-sa-token\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.431118 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.430947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c202b06-f1b8-4708-8247-2b11afb29a88-installation-pull-secrets\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.431118 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.430983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c202b06-f1b8-4708-8247-2b11afb29a88-image-registry-private-configuration\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.431290 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.431265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c202b06-f1b8-4708-8247-2b11afb29a88-ca-trust-extracted\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.431779 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.431753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c202b06-f1b8-4708-8247-2b11afb29a88-ca-trust-extracted\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.432181 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.432155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c202b06-f1b8-4708-8247-2b11afb29a88-registry-certificates\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.432264 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.432213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c202b06-f1b8-4708-8247-2b11afb29a88-trusted-ca\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.433746 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.433719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c202b06-f1b8-4708-8247-2b11afb29a88-installation-pull-secrets\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.433829 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.433749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-registry-tls\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.433875 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.433864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c202b06-f1b8-4708-8247-2b11afb29a88-image-registry-private-configuration\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.442737 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.442716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-bound-sa-token\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.442983 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.442965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdl2v\" (UniqueName: \"kubernetes.io/projected/4c202b06-f1b8-4708-8247-2b11afb29a88-kube-api-access-bdl2v\") pod \"image-registry-7765ddb8dd-cpng4\" (UID: \"4c202b06-f1b8-4708-8247-2b11afb29a88\") " pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.511176 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.511144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:35.679465 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.679387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk"]
Sep 04 22:10:35.682459 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:35.682431    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7032c21f_a95a_4622_94eb_3fb98390ae01.slice/crio-4e924a6e9f4dc801ad4f774cf1316aafb252da393f50d8d5e79a10f1a402c292 WatchSource:0}: Error finding container 4e924a6e9f4dc801ad4f774cf1316aafb252da393f50d8d5e79a10f1a402c292: Status 404 returned error can't find the container with id 4e924a6e9f4dc801ad4f774cf1316aafb252da393f50d8d5e79a10f1a402c292
Sep 04 22:10:35.783118 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:35.783086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7765ddb8dd-cpng4"]
Sep 04 22:10:35.786016 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:35.785991    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c202b06_f1b8_4708_8247_2b11afb29a88.slice/crio-474a86f77b454a75bec58d3aced2ffb72009c19ec24a1b4ff99eb7cae1fffa85 WatchSource:0}: Error finding container 474a86f77b454a75bec58d3aced2ffb72009c19ec24a1b4ff99eb7cae1fffa85: Status 404 returned error can't find the container with id 474a86f77b454a75bec58d3aced2ffb72009c19ec24a1b4ff99eb7cae1fffa85
Sep 04 22:10:36.137094 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.137054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:36.139270 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.139252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91c83992-9df0-4630-b125-0ad6c9166b44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-plhrr\" (UID: \"91c83992-9df0-4630-b125-0ad6c9166b44\") " pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:36.174009 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.173974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4" event={"ID":"4c202b06-f1b8-4708-8247-2b11afb29a88","Type":"ContainerStarted","Data":"81fcd3590fa30c5a5482153f03eb104a7683c128ad8e317a88e33fefdc51eafc"}
Sep 04 22:10:36.174192 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.174033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4" event={"ID":"4c202b06-f1b8-4708-8247-2b11afb29a88","Type":"ContainerStarted","Data":"474a86f77b454a75bec58d3aced2ffb72009c19ec24a1b4ff99eb7cae1fffa85"}
Sep 04 22:10:36.174268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.174188    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:36.175194 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.175172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk" event={"ID":"7032c21f-a95a-4622-94eb-3fb98390ae01","Type":"ContainerStarted","Data":"4e924a6e9f4dc801ad4f774cf1316aafb252da393f50d8d5e79a10f1a402c292"}
Sep 04 22:10:36.195363 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.195298    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4" podStartSLOduration=1.195286226 podStartE2EDuration="1.195286226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:36.193997437 +0000 UTC m=+109.998354962" watchObservedRunningTime="2026-09-04 22:10:36.195286226 +0000 UTC m=+109.999643749"
Sep 04 22:10:36.439206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.439133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-plhrr"
Sep 04 22:10:36.708183 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:36.708119    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-plhrr"]
Sep 04 22:10:36.711014 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:36.710989    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c83992_9df0_4630_b125_0ad6c9166b44.slice/crio-16af4b4e61a23e6190d7068a8cd79a6ab96ea39ad19bc28f329e36f2aaa84e32 WatchSource:0}: Error finding container 16af4b4e61a23e6190d7068a8cd79a6ab96ea39ad19bc28f329e36f2aaa84e32: Status 404 returned error can't find the container with id 16af4b4e61a23e6190d7068a8cd79a6ab96ea39ad19bc28f329e36f2aaa84e32
Sep 04 22:10:37.182012 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:37.181967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-plhrr" event={"ID":"91c83992-9df0-4630-b125-0ad6c9166b44","Type":"ContainerStarted","Data":"46a1dbbae2c59f9f61815c569edfd636f089b3f2e39c402c97d7a2bed9e3657e"}
Sep 04 22:10:37.182542 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:37.182080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-plhrr" event={"ID":"91c83992-9df0-4630-b125-0ad6c9166b44","Type":"ContainerStarted","Data":"16af4b4e61a23e6190d7068a8cd79a6ab96ea39ad19bc28f329e36f2aaa84e32"}
Sep 04 22:10:38.149906 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:38.149871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t2wsr"
Sep 04 22:10:39.192245 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:39.192214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-plhrr" event={"ID":"91c83992-9df0-4630-b125-0ad6c9166b44","Type":"ContainerStarted","Data":"147baad60841c3885fbb86ae4263075dcd7b1c5838f9f0f02827b06eac6564c6"}
Sep 04 22:10:39.193852 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:39.193818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk" event={"ID":"7032c21f-a95a-4622-94eb-3fb98390ae01","Type":"ContainerStarted","Data":"a6fedeae6387933f3d5bd0d6443e7178af03c4e2624ea6cc0d3b62b02fcd66ef"}
Sep 04 22:10:39.212043 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:39.211998    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-869d4cb58-bpzjk" podStartSLOduration=1.362754222 podStartE2EDuration="4.21198347s" totalImagesPullingTime="2.849229248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:39.211406569 +0000 UTC m=+113.015764093" watchObservedRunningTime="2026-09-04 22:10:39.21198347 +0000 UTC m=+113.016340993"
Sep 04 22:10:40.198943 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:40.198906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-plhrr" event={"ID":"91c83992-9df0-4630-b125-0ad6c9166b44","Type":"ContainerStarted","Data":"d180e81669aa182662bd87ad0dbbe0fce24f2ca98df83844297eab9f509d6cb5"}
Sep 04 22:10:40.221666 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:40.221620    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-plhrr" podStartSLOduration=33.328715625 podStartE2EDuration="36.221593084s" totalImagesPullingTime="2.892877459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:10:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:40.220418459 +0000 UTC m=+114.024775983" watchObservedRunningTime="2026-09-04 22:10:40.221593084 +0000 UTC m=+114.025950609"
Sep 04 22:10:41.019366 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.019330    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"]
Sep 04 22:10:41.024197 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.024180    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.026645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.026618    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 04 22:10:41.026781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.026670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 04 22:10:41.027334 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.027316    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 04 22:10:41.027334 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.027327    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 04 22:10:41.027334 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.027332    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5t8mq\""
Sep 04 22:10:41.027494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.027337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 04 22:10:41.033075 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.033054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"]
Sep 04 22:10:41.176425 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.176397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.176553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.176438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jsqc\" (UniqueName: \"kubernetes.io/projected/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-kube-api-access-9jsqc\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.176553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.176468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.176553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.176525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.277674 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.277591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jsqc\" (UniqueName: \"kubernetes.io/projected/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-kube-api-access-9jsqc\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.277674 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.277646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.278120 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.277674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.278120 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.277702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.278396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.278377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.279991 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.279971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.280061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.280046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.286545 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.286521    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jsqc\" (UniqueName: \"kubernetes.io/projected/80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7-kube-api-access-9jsqc\") pod \"prometheus-operator-6f4946db56-ppgd5\" (UID: \"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.332444 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.332422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"
Sep 04 22:10:41.603581 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:41.603546    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-ppgd5"]
Sep 04 22:10:41.606397 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:41.606369    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e7b4b3_c59d_41c4_ad20_fc03fe6aacf7.slice/crio-03d497f6f0d94dfe803e086c73ec84b401b9c2dfb9a33a9d44bec4169d7967f1 WatchSource:0}: Error finding container 03d497f6f0d94dfe803e086c73ec84b401b9c2dfb9a33a9d44bec4169d7967f1: Status 404 returned error can't find the container with id 03d497f6f0d94dfe803e086c73ec84b401b9c2dfb9a33a9d44bec4169d7967f1
Sep 04 22:10:42.209515 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:42.209475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5" event={"ID":"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7","Type":"ContainerStarted","Data":"03d497f6f0d94dfe803e086c73ec84b401b9c2dfb9a33a9d44bec4169d7967f1"}
Sep 04 22:10:43.214527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:43.214499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5" event={"ID":"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7","Type":"ContainerStarted","Data":"d80dfe62d36d0ed7515027d9b0f63068b80c064be3137bd45043b3627756e3ca"}
Sep 04 22:10:43.214848 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:43.214559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5" event={"ID":"80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7","Type":"ContainerStarted","Data":"c526b1dc9dd41e7dfa725cf26b5eef41daa4ff39e0bb16ff65f0c1578fcba171"}
Sep 04 22:10:44.242287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:44.242232    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-ppgd5" podStartSLOduration=1.8238453529999998 podStartE2EDuration="3.242217201s" totalImagesPullingTime="1.418371848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:44.24161443 +0000 UTC m=+118.045971966" watchObservedRunningTime="2026-09-04 22:10:44.242217201 +0000 UTC m=+118.046574724"
Sep 04 22:10:46.417937 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.417900    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"]
Sep 04 22:10:46.420031 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.420014    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.422258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.422235    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bg7dc\""
Sep 04 22:10:46.423021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.422978    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 04 22:10:46.423021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.422995    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 04 22:10:46.423021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.422998    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 04 22:10:46.424290 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.424267    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tth9d"]
Sep 04 22:10:46.426494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.426337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.428697 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.428679    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 04 22:10:46.428907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.428892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fxd5g\""
Sep 04 22:10:46.429296 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.429279    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 04 22:10:46.429527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.429512    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 04 22:10:46.441049 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.441029    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"]
Sep 04 22:10:46.509585 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-textfile\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.509712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-wtmp\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.509712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.509712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.509810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-tls\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.509810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.509810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq7fm\" (UniqueName: \"kubernetes.io/projected/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-api-access-sq7fm\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.509810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.509931 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.509931 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbw98\" (UniqueName: \"kubernetes.io/projected/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-kube-api-access-wbw98\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.509931 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.509931 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-root\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.510050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-metrics-client-ca\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.510050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.510050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.509989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-sys\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-wtmp\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612493 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.612493 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.612493 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-tls\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612493 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-wtmp\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq7fm\" (UniqueName: \"kubernetes.io/projected/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-api-access-sq7fm\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.612743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.612891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbw98\" (UniqueName: \"kubernetes.io/projected/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-kube-api-access-wbw98\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.612891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-root\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.612891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-metrics-client-ca\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.613125 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.613125 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-sys\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.613125 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.612954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-textfile\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.613274 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.613130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-root\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.613274 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.613187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-sys\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.613370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.613299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-textfile\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.613496 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.613478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.613668 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.613634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-metrics-client-ca\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.613790 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.613748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.614980 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.614953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 04 22:10:46.615073 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.615047    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 04 22:10:46.615073 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.615055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 04 22:10:46.615280 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.615259    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 04 22:10:46.615362 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.615289    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 04 22:10:46.615362 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.615296    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 04 22:10:46.623119 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.623098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.623527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.623501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.624272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.624248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbw98\" (UniqueName: \"kubernetes.io/projected/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-kube-api-access-wbw98\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.624872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.624849    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq7fm\" (UniqueName: \"kubernetes.io/projected/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-api-access-sq7fm\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.625112 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.625088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-tls\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.625465 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.625445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.625720 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.625699    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85a6c08e-6b16-4e59-8c18-cd9b6decb1ee-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mw8q4\" (UID: \"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.625773 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.625711    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3686e0c1-4b82-4a64-b017-5c8fae1f09b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tth9d\" (UID: \"3686e0c1-4b82-4a64-b017-5c8fae1f09b4\") " pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.731729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.731656    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bg7dc\""
Sep 04 22:10:46.737966 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.737945    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fxd5g\""
Sep 04 22:10:46.739711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.739697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"
Sep 04 22:10:46.746245 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:46.746222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tth9d"
Sep 04 22:10:46.756377 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:46.756355    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3686e0c1_4b82_4a64_b017_5c8fae1f09b4.slice/crio-e8a1f83ee1c9c4e9bab7497e13cf61ad70ff1b97165ec707a2e9389a7e4682ed WatchSource:0}: Error finding container e8a1f83ee1c9c4e9bab7497e13cf61ad70ff1b97165ec707a2e9389a7e4682ed: Status 404 returned error can't find the container with id e8a1f83ee1c9c4e9bab7497e13cf61ad70ff1b97165ec707a2e9389a7e4682ed
Sep 04 22:10:47.024433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:47.024366    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4"]
Sep 04 22:10:47.027502 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:47.027477    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a6c08e_6b16_4e59_8c18_cd9b6decb1ee.slice/crio-5e523560e30703c6ee701bb3816c057bb78ec41127c3eaf9420ff2bfc1d46368 WatchSource:0}: Error finding container 5e523560e30703c6ee701bb3816c057bb78ec41127c3eaf9420ff2bfc1d46368: Status 404 returned error can't find the container with id 5e523560e30703c6ee701bb3816c057bb78ec41127c3eaf9420ff2bfc1d46368
Sep 04 22:10:47.232398 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:47.232352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tth9d" event={"ID":"3686e0c1-4b82-4a64-b017-5c8fae1f09b4","Type":"ContainerStarted","Data":"e8a1f83ee1c9c4e9bab7497e13cf61ad70ff1b97165ec707a2e9389a7e4682ed"}
Sep 04 22:10:47.233833 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:47.233805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4" event={"ID":"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee","Type":"ContainerStarted","Data":"5e523560e30703c6ee701bb3816c057bb78ec41127c3eaf9420ff2bfc1d46368"}
Sep 04 22:10:48.239804 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:48.239713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tth9d" event={"ID":"3686e0c1-4b82-4a64-b017-5c8fae1f09b4","Type":"ContainerStarted","Data":"9a6a1b6d35abdcc1d8fad5bc40f3be8b05d1646ecc6803a665c17d215c834789"}
Sep 04 22:10:49.244679 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:49.244639    2564 generic.go:356] "Generic (PLEG): container finished" podID="3686e0c1-4b82-4a64-b017-5c8fae1f09b4" containerID="9a6a1b6d35abdcc1d8fad5bc40f3be8b05d1646ecc6803a665c17d215c834789" exitCode=0
Sep 04 22:10:49.245075 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:49.244736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tth9d" event={"ID":"3686e0c1-4b82-4a64-b017-5c8fae1f09b4","Type":"ContainerDied","Data":"9a6a1b6d35abdcc1d8fad5bc40f3be8b05d1646ecc6803a665c17d215c834789"}
Sep 04 22:10:49.247041 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:49.247015    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4" event={"ID":"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee","Type":"ContainerStarted","Data":"5551fcd845cdfe99db972e1d8d3c29a5f0b8794d1be44a9c7a9ee5b5ae7829bf"}
Sep 04 22:10:49.247145 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:49.247066    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4" event={"ID":"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee","Type":"ContainerStarted","Data":"85a7832c2613d05476c2137d22b05d5a9fb1d815fc25157cf5952ae5b43da198"}
Sep 04 22:10:49.247145 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:49.247096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4" event={"ID":"85a6c08e-6b16-4e59-8c18-cd9b6decb1ee","Type":"ContainerStarted","Data":"76425a13bf254d1853be60bf83412d943fed07e52371bd2e2460e4d16c255a83"}
Sep 04 22:10:49.286062 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:49.286016    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mw8q4" podStartSLOduration=1.906569666 podStartE2EDuration="3.286001754s" totalImagesPullingTime="1.379432088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:49.285036836 +0000 UTC m=+123.089394373" watchObservedRunningTime="2026-09-04 22:10:49.286001754 +0000 UTC m=+123.090359280"
Sep 04 22:10:50.252852 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:50.252810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tth9d" event={"ID":"3686e0c1-4b82-4a64-b017-5c8fae1f09b4","Type":"ContainerStarted","Data":"b2f5a7fdd3d3027b72c853f9e24e1882a9b54e4668f2bdd49fb3ea45e4a80feb"}
Sep 04 22:10:50.253323 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:50.252868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tth9d" event={"ID":"3686e0c1-4b82-4a64-b017-5c8fae1f09b4","Type":"ContainerStarted","Data":"8672a24080f3f6117a06aff6bcdb5ece0c98c798e3e44ff779c87aa27bfd896a"}
Sep 04 22:10:50.274425 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:50.274380    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tth9d" podStartSLOduration=2.97448954 podStartE2EDuration="4.274364262s" totalImagesPullingTime="1.231702698s" totalInitContainerRuntime="68.172024ms" isStatefulPod=true podCreationTimestamp="2026-09-04 22:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:50.273073058 +0000 UTC m=+124.077430584" watchObservedRunningTime="2026-09-04 22:10:50.274364262 +0000 UTC m=+124.078721786"
Sep 04 22:10:51.516702 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.516642    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-pv8w5"]
Sep 04 22:10:51.520151 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.520128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-pv8w5"
Sep 04 22:10:51.522584 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.522558    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v6g24\""
Sep 04 22:10:51.522584 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.522558    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 04 22:10:51.522975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.522952    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 04 22:10:51.534118 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.534092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-pv8w5"]
Sep 04 22:10:51.653435 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.653405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8f8\" (UniqueName: \"kubernetes.io/projected/39a362d4-d9d3-4a34-a49b-2040e48c18c7-kube-api-access-rk8f8\") pod \"downloads-85d98c998f-pv8w5\" (UID: \"39a362d4-d9d3-4a34-a49b-2040e48c18c7\") " pod="openshift-console/downloads-85d98c998f-pv8w5"
Sep 04 22:10:51.753841 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.753801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8f8\" (UniqueName: \"kubernetes.io/projected/39a362d4-d9d3-4a34-a49b-2040e48c18c7-kube-api-access-rk8f8\") pod \"downloads-85d98c998f-pv8w5\" (UID: \"39a362d4-d9d3-4a34-a49b-2040e48c18c7\") " pod="openshift-console/downloads-85d98c998f-pv8w5"
Sep 04 22:10:51.773239 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.773175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8f8\" (UniqueName: \"kubernetes.io/projected/39a362d4-d9d3-4a34-a49b-2040e48c18c7-kube-api-access-rk8f8\") pod \"downloads-85d98c998f-pv8w5\" (UID: \"39a362d4-d9d3-4a34-a49b-2040e48c18c7\") " pod="openshift-console/downloads-85d98c998f-pv8w5"
Sep 04 22:10:51.832847 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:51.832818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-pv8w5"
Sep 04 22:10:52.104694 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:52.104665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-pv8w5"]
Sep 04 22:10:52.107994 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:52.107961    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a362d4_d9d3_4a34_a49b_2040e48c18c7.slice/crio-c08146ac867c08273f69ea489706e71362e417ebfbf1afe3453b548daf2b8431 WatchSource:0}: Error finding container c08146ac867c08273f69ea489706e71362e417ebfbf1afe3453b548daf2b8431: Status 404 returned error can't find the container with id c08146ac867c08273f69ea489706e71362e417ebfbf1afe3453b548daf2b8431
Sep 04 22:10:52.261285 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:52.261255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-pv8w5" event={"ID":"39a362d4-d9d3-4a34-a49b-2040e48c18c7","Type":"ContainerStarted","Data":"c08146ac867c08273f69ea489706e71362e417ebfbf1afe3453b548daf2b8431"}
Sep 04 22:10:56.494659 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:56.494625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:10:56.497339 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:56.497308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3f6f05c-3c83-4651-b5c8-43e643e24496-metrics-certs\") pod \"network-metrics-daemon-m6gh8\" (UID: \"b3f6f05c-3c83-4651-b5c8-43e643e24496\") " pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:10:56.787499 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:56.787421    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c64pf\""
Sep 04 22:10:56.796376 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:56.796350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m6gh8"
Sep 04 22:10:57.076189 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:57.076155    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m6gh8"]
Sep 04 22:10:57.079363 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:10:57.079334    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f6f05c_3c83_4651_b5c8_43e643e24496.slice/crio-55732f4016fcaae55c306e862b4690fa9231894d6f1d977ee68f2570e1b8cae6 WatchSource:0}: Error finding container 55732f4016fcaae55c306e862b4690fa9231894d6f1d977ee68f2570e1b8cae6: Status 404 returned error can't find the container with id 55732f4016fcaae55c306e862b4690fa9231894d6f1d977ee68f2570e1b8cae6
Sep 04 22:10:57.186789 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:57.186759    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7765ddb8dd-cpng4"
Sep 04 22:10:57.283158 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:57.283122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m6gh8" event={"ID":"b3f6f05c-3c83-4651-b5c8-43e643e24496","Type":"ContainerStarted","Data":"55732f4016fcaae55c306e862b4690fa9231894d6f1d977ee68f2570e1b8cae6"}
Sep 04 22:10:59.296545 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:59.296505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m6gh8" event={"ID":"b3f6f05c-3c83-4651-b5c8-43e643e24496","Type":"ContainerStarted","Data":"fd7b1d63a4578592c301a56e8240219bd2d63ef096a8b9c4ddd4bf08e6f576ac"}
Sep 04 22:10:59.297065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:59.296573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m6gh8" event={"ID":"b3f6f05c-3c83-4651-b5c8-43e643e24496","Type":"ContainerStarted","Data":"249dfb38b36eb6cc28cb58f350dbb0ad59105b393ee16d209140df9f7cfe44a2"}
Sep 04 22:10:59.315223 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:10:59.315174    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m6gh8" podStartSLOduration=131.209967348 podStartE2EDuration="2m12.31515822s" totalImagesPullingTime="1.105190872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:10:59.314475241 +0000 UTC m=+133.118832777" watchObservedRunningTime="2026-09-04 22:10:59.31515822 +0000 UTC m=+133.119515743"
Sep 04 22:11:09.337553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:09.337508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-pv8w5" event={"ID":"39a362d4-d9d3-4a34-a49b-2040e48c18c7","Type":"ContainerStarted","Data":"9be4693a7d61ed005b2c06193dc7d2e74fc4948bd479dc4d395d15c5bf883a0f"}
Sep 04 22:11:09.338068 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:09.338041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-pv8w5"
Sep 04 22:11:09.355908 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:09.355852    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-pv8w5" podStartSLOduration=1.420704351 podStartE2EDuration="18.355833872s" totalImagesPullingTime="16.935129521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:11:09.355715236 +0000 UTC m=+143.160072764" watchObservedRunningTime="2026-09-04 22:11:09.355833872 +0000 UTC m=+143.160191397"
Sep 04 22:11:09.357215 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:09.357188    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-pv8w5"
Sep 04 22:11:13.360214 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:13.360178    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5a791a7-0a61-4501-b0c5-3789ffca6261" containerID="da3f19d548293e262948951629d1d4689ac0d1825a67cd6fd079caa8cb6f87ee" exitCode=0
Sep 04 22:11:13.360683 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:13.360265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s" event={"ID":"e5a791a7-0a61-4501-b0c5-3789ffca6261","Type":"ContainerDied","Data":"da3f19d548293e262948951629d1d4689ac0d1825a67cd6fd079caa8cb6f87ee"}
Sep 04 22:11:13.360683 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:13.360677    2564 scope.go:117] "RemoveContainer" containerID="da3f19d548293e262948951629d1d4689ac0d1825a67cd6fd079caa8cb6f87ee"
Sep 04 22:11:14.367071 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:14.367032    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-7zl8s" event={"ID":"e5a791a7-0a61-4501-b0c5-3789ffca6261","Type":"ContainerStarted","Data":"9f7089460938be19c88e1179d8c855dd404ba8d637a47afeabd4fdaed3ef6278"}
Sep 04 22:11:18.679657 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:18.679628    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mw8q4_85a6c08e-6b16-4e59-8c18-cd9b6decb1ee/kube-state-metrics/0.log"
Sep 04 22:11:18.879828 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:18.879785    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mw8q4_85a6c08e-6b16-4e59-8c18-cd9b6decb1ee/kube-rbac-proxy-main/0.log"
Sep 04 22:11:19.079260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:19.079229    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mw8q4_85a6c08e-6b16-4e59-8c18-cd9b6decb1ee/kube-rbac-proxy-self/0.log"
Sep 04 22:11:20.880462 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:20.880433    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tth9d_3686e0c1-4b82-4a64-b017-5c8fae1f09b4/init-textfile/0.log"
Sep 04 22:11:21.081021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:21.080982    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tth9d_3686e0c1-4b82-4a64-b017-5c8fae1f09b4/node-exporter/0.log"
Sep 04 22:11:21.280197 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:21.280117    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tth9d_3686e0c1-4b82-4a64-b017-5c8fae1f09b4/kube-rbac-proxy/0.log"
Sep 04 22:11:23.484190 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:23.484154    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-ppgd5_80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7/prometheus-operator/0.log"
Sep 04 22:11:23.683540 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:23.683493    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-ppgd5_80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7/kube-rbac-proxy/0.log"
Sep 04 22:11:26.286092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:26.286055    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-pv8w5_39a362d4-d9d3-4a34-a49b-2040e48c18c7/download-server/0.log"
Sep 04 22:11:26.412767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:26.412737    2564 generic.go:356] "Generic (PLEG): container finished" podID="52e42ee9-0bbb-4be6-b270-427a235d069d" containerID="de95b283baafe83b162a4288320256e3924d5f030655bf64b664172bf929d543" exitCode=0
Sep 04 22:11:26.412910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:26.412817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv" event={"ID":"52e42ee9-0bbb-4be6-b270-427a235d069d","Type":"ContainerDied","Data":"de95b283baafe83b162a4288320256e3924d5f030655bf64b664172bf929d543"}
Sep 04 22:11:26.413123 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:26.413109    2564 scope.go:117] "RemoveContainer" containerID="de95b283baafe83b162a4288320256e3924d5f030655bf64b664172bf929d543"
Sep 04 22:11:27.281193 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:27.281161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2wsr_365fa8d5-afda-473a-ae2c-9fdf8e16313b/dns/0.log"
Sep 04 22:11:27.418325 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:27.418288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vnfrv" event={"ID":"52e42ee9-0bbb-4be6-b270-427a235d069d","Type":"ContainerStarted","Data":"b05271da9d6ffe93c4e7ff9da28ee04f2a218129bd86d4b11671570a7b4216c7"}
Sep 04 22:11:27.480321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:27.480295    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2wsr_365fa8d5-afda-473a-ae2c-9fdf8e16313b/kube-rbac-proxy/0.log"
Sep 04 22:11:27.881769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:27.881733    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ngj8_55666064-c8a5-4d05-9b9c-b255bc3b0d4a/dns-node-resolver/0.log"
Sep 04 22:11:28.680452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:11:28.680423    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9752r_5e18588a-0b92-41dd-ba69-4ec8ac138d4b/serve-healthcheck-canary/0.log"
Sep 04 22:13:46.557946 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:13:46.557916    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 04 22:14:55.460359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.460326    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l4r45"]
Sep 04 22:14:55.462204 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.462188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:55.464898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.464870    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 04 22:14:55.465743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.465724    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 04 22:14:55.465830 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.465728    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-s4lt7\""
Sep 04 22:14:55.482391 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.482357    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l4r45"]
Sep 04 22:14:55.574216 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.574186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf561354-0427-4df0-995b-746327c24b42-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l4r45\" (UID: \"bf561354-0427-4df0-995b-746327c24b42\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:55.574342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.574221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xmgc\" (UniqueName: \"kubernetes.io/projected/bf561354-0427-4df0-995b-746327c24b42-kube-api-access-9xmgc\") pod \"cert-manager-webhook-6486ffd997-l4r45\" (UID: \"bf561354-0427-4df0-995b-746327c24b42\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:55.675481 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.675450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf561354-0427-4df0-995b-746327c24b42-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l4r45\" (UID: \"bf561354-0427-4df0-995b-746327c24b42\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:55.675659 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.675490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xmgc\" (UniqueName: \"kubernetes.io/projected/bf561354-0427-4df0-995b-746327c24b42-kube-api-access-9xmgc\") pod \"cert-manager-webhook-6486ffd997-l4r45\" (UID: \"bf561354-0427-4df0-995b-746327c24b42\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:55.687263 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.687236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf561354-0427-4df0-995b-746327c24b42-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l4r45\" (UID: \"bf561354-0427-4df0-995b-746327c24b42\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:55.690190 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.690167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xmgc\" (UniqueName: \"kubernetes.io/projected/bf561354-0427-4df0-995b-746327c24b42-kube-api-access-9xmgc\") pod \"cert-manager-webhook-6486ffd997-l4r45\" (UID: \"bf561354-0427-4df0-995b-746327c24b42\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:55.771059 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:55.770997    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:56.050492 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:56.050441    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l4r45"]
Sep 04 22:14:56.053561 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:14:56.053526    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf561354_0427_4df0_995b_746327c24b42.slice/crio-eae82c165faf2d669a7260874dadcaf475f80bf04b9d08c1b23fadc786131fc1 WatchSource:0}: Error finding container eae82c165faf2d669a7260874dadcaf475f80bf04b9d08c1b23fadc786131fc1: Status 404 returned error can't find the container with id eae82c165faf2d669a7260874dadcaf475f80bf04b9d08c1b23fadc786131fc1
Sep 04 22:14:56.055595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:56.055579    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:14:56.156750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:56.156720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45" event={"ID":"bf561354-0427-4df0-995b-746327c24b42","Type":"ContainerStarted","Data":"eae82c165faf2d669a7260874dadcaf475f80bf04b9d08c1b23fadc786131fc1"}
Sep 04 22:14:59.170444 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:59.170417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45" event={"ID":"bf561354-0427-4df0-995b-746327c24b42","Type":"ContainerStarted","Data":"a3f5f35e16ad9313f976fc39ad89584584ca94658c17a69109de380655524c74"}
Sep 04 22:14:59.170816 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:59.170542    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:14:59.208224 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:14:59.208136    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45" podStartSLOduration=1.307618974 podStartE2EDuration="4.208124311s" totalImagesPullingTime="2.900505337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:14:59.207758375 +0000 UTC m=+373.012115901" watchObservedRunningTime="2026-09-04 22:14:59.208124311 +0000 UTC m=+373.012481835"
Sep 04 22:15:04.859198 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:04.859161    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5gmvr"]
Sep 04 22:15:04.861438 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:04.861420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:04.863713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:04.863690    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pmj7f\""
Sep 04 22:15:04.874128 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:04.874103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5gmvr"]
Sep 04 22:15:04.939152 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:04.939122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dl28\" (UniqueName: \"kubernetes.io/projected/bcfc1488-b969-4231-b025-b6086d85fba9-kube-api-access-6dl28\") pod \"cert-manager-55b4d954d5-5gmvr\" (UID: \"bcfc1488-b969-4231-b025-b6086d85fba9\") " pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:04.939278 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:04.939182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcfc1488-b969-4231-b025-b6086d85fba9-bound-sa-token\") pod \"cert-manager-55b4d954d5-5gmvr\" (UID: \"bcfc1488-b969-4231-b025-b6086d85fba9\") " pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:05.039830 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:05.039799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dl28\" (UniqueName: \"kubernetes.io/projected/bcfc1488-b969-4231-b025-b6086d85fba9-kube-api-access-6dl28\") pod \"cert-manager-55b4d954d5-5gmvr\" (UID: \"bcfc1488-b969-4231-b025-b6086d85fba9\") " pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:05.039947 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:05.039860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcfc1488-b969-4231-b025-b6086d85fba9-bound-sa-token\") pod \"cert-manager-55b4d954d5-5gmvr\" (UID: \"bcfc1488-b969-4231-b025-b6086d85fba9\") " pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:05.049941 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:05.049913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcfc1488-b969-4231-b025-b6086d85fba9-bound-sa-token\") pod \"cert-manager-55b4d954d5-5gmvr\" (UID: \"bcfc1488-b969-4231-b025-b6086d85fba9\") " pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:05.050142 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:05.050123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dl28\" (UniqueName: \"kubernetes.io/projected/bcfc1488-b969-4231-b025-b6086d85fba9-kube-api-access-6dl28\") pod \"cert-manager-55b4d954d5-5gmvr\" (UID: \"bcfc1488-b969-4231-b025-b6086d85fba9\") " pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:05.169556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:05.169477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5gmvr"
Sep 04 22:15:05.177342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:05.177318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l4r45"
Sep 04 22:15:05.441941 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:05.441917    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5gmvr"]
Sep 04 22:15:05.444310 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:15:05.444281    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcfc1488_b969_4231_b025_b6086d85fba9.slice/crio-3b6a50aaed2d1d6acba378a14bc171dc284a799fe6c31155cb8c20be0042bb86 WatchSource:0}: Error finding container 3b6a50aaed2d1d6acba378a14bc171dc284a799fe6c31155cb8c20be0042bb86: Status 404 returned error can't find the container with id 3b6a50aaed2d1d6acba378a14bc171dc284a799fe6c31155cb8c20be0042bb86
Sep 04 22:15:06.197526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:06.197491    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5gmvr" event={"ID":"bcfc1488-b969-4231-b025-b6086d85fba9","Type":"ContainerStarted","Data":"107e8640eedc6fd1cecc252a06d6d5f5cb0aeac13fe550f241e68b0e3098ba6c"}
Sep 04 22:15:06.197526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:06.197533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5gmvr" event={"ID":"bcfc1488-b969-4231-b025-b6086d85fba9","Type":"ContainerStarted","Data":"3b6a50aaed2d1d6acba378a14bc171dc284a799fe6c31155cb8c20be0042bb86"}
Sep 04 22:15:06.216646 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:06.216587    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5gmvr" podStartSLOduration=2.216572097 podStartE2EDuration="2.216572097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:06.216337178 +0000 UTC m=+380.020694702" watchObservedRunningTime="2026-09-04 22:15:06.216572097 +0000 UTC m=+380.020929621"
Sep 04 22:15:27.715536 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.715500    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"]
Sep 04 22:15:27.719108 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.719089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.721541 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.721513    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 04 22:15:27.721660 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.721557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 04 22:15:27.721776 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.721755    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 04 22:15:27.721890 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.721872    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 04 22:15:27.722721 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.722697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kvsxk\""
Sep 04 22:15:27.748206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.748184    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"]
Sep 04 22:15:27.794912 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.794887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.795016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.794926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-manifests\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.795016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.794959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cbj4\" (UniqueName: \"kubernetes.io/projected/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-kube-api-access-7cbj4\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.795016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.794995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.795148 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.795022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-tmp\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.896293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.896253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-tmp\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.896444 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.896314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.896444 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.896357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-manifests\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.896444 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.896400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cbj4\" (UniqueName: \"kubernetes.io/projected/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-kube-api-access-7cbj4\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.896593 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.896577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.896777 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.896750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-manifests\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.898514 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.898492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-tmp\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.898826 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.898804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.898982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.898967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:27.907536 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:27.907515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cbj4\" (UniqueName: \"kubernetes.io/projected/82a1b0dc-fbcc-4f9a-908c-1b4d8b832678-kube-api-access-7cbj4\") pod \"opendatahub-operator-controller-manager-cd686f5d7-62f5v\" (UID: \"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678\") " pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:28.034093 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:28.034015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:28.339792 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:28.339769    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"]
Sep 04 22:15:28.342089 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:15:28.342061    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a1b0dc_fbcc_4f9a_908c_1b4d8b832678.slice/crio-4b3a969f67f4482287e78d1e0bedca28dcc87bdcd7b21cc4815494615efccb94 WatchSource:0}: Error finding container 4b3a969f67f4482287e78d1e0bedca28dcc87bdcd7b21cc4815494615efccb94: Status 404 returned error can't find the container with id 4b3a969f67f4482287e78d1e0bedca28dcc87bdcd7b21cc4815494615efccb94
Sep 04 22:15:29.285322 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:29.285277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v" event={"ID":"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678","Type":"ContainerStarted","Data":"4b3a969f67f4482287e78d1e0bedca28dcc87bdcd7b21cc4815494615efccb94"}
Sep 04 22:15:31.295397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:31.295366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v" event={"ID":"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678","Type":"ContainerStarted","Data":"ce523b5b963e3cb7f74b1b90d700644ec6392710f025290f67561224cb496ed1"}
Sep 04 22:15:32.301779 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:32.301744    2564 generic.go:356] "Generic (PLEG): container finished" podID="82a1b0dc-fbcc-4f9a-908c-1b4d8b832678" containerID="ce523b5b963e3cb7f74b1b90d700644ec6392710f025290f67561224cb496ed1" exitCode=0
Sep 04 22:15:32.302136 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:32.301829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v" event={"ID":"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678","Type":"ContainerDied","Data":"ce523b5b963e3cb7f74b1b90d700644ec6392710f025290f67561224cb496ed1"}
Sep 04 22:15:33.309743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:33.309709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v" event={"ID":"82a1b0dc-fbcc-4f9a-908c-1b4d8b832678","Type":"ContainerStarted","Data":"48007de5fa59abf11dc26fb5d73822297acdc4efaf83e1928ef8a1b8153433da"}
Sep 04 22:15:33.310152 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:33.309794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:44.316743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:44.316713    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v"
Sep 04 22:15:44.351458 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:44.351409    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cd686f5d7-62f5v" podStartSLOduration=13.048171039 podStartE2EDuration="17.351396706s" totalImagesPullingTime="3.269237087s" totalInitContainerRuntime="1.03398858s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:33.35878163 +0000 UTC m=+407.163139154" watchObservedRunningTime="2026-09-04 22:15:44.351396706 +0000 UTC m=+418.155754230"
Sep 04 22:15:47.481474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.481442    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7766956b67-gctsx"]
Sep 04 22:15:47.484281 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.484258    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.492774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.492752    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 04 22:15:47.493561 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.493543    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 04 22:15:47.495672 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.495654    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 04 22:15:47.495758 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.495654    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 04 22:15:47.557152 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.557123    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7766956b67-gctsx"]
Sep 04 22:15:47.650882 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.650850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tls-certs\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.650882 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.650886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tmp\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.651082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.650917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl6xx\" (UniqueName: \"kubernetes.io/projected/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-kube-api-access-kl6xx\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.751831 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.751753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tls-certs\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.751831 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.751793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tmp\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.752030 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.751833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl6xx\" (UniqueName: \"kubernetes.io/projected/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-kube-api-access-kl6xx\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.752030 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:15:47.751895    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 04 22:15:47.752030 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:15:47.751962    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tls-certs podName:6b486dbd-39a5-45f5-b939-8ed4dc1894d6 nodeName:}" failed. No retries permitted until 2026-09-04 22:15:48.25194599 +0000 UTC m=+422.056303495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tls-certs") pod "kube-auth-proxy-7766956b67-gctsx" (UID: "6b486dbd-39a5-45f5-b939-8ed4dc1894d6") : secret "kube-auth-proxy-tls" not found
Sep 04 22:15:47.754084 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.754061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tmp\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:47.772273 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:47.772242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl6xx\" (UniqueName: \"kubernetes.io/projected/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-kube-api-access-kl6xx\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:48.254773 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:48.254742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tls-certs\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:48.257046 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:48.257026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b486dbd-39a5-45f5-b939-8ed4dc1894d6-tls-certs\") pod \"kube-auth-proxy-7766956b67-gctsx\" (UID: \"6b486dbd-39a5-45f5-b939-8ed4dc1894d6\") " pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:48.393276 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:48.393250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx"
Sep 04 22:15:48.684166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:48.684137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7766956b67-gctsx"]
Sep 04 22:15:48.687818 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:15:48.687780    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b486dbd_39a5_45f5_b939_8ed4dc1894d6.slice/crio-a0b9d66daf3f41b021d8d0c8946d9ddcd63cb5fcb44c12272c3b665cdb233725 WatchSource:0}: Error finding container a0b9d66daf3f41b021d8d0c8946d9ddcd63cb5fcb44c12272c3b665cdb233725: Status 404 returned error can't find the container with id a0b9d66daf3f41b021d8d0c8946d9ddcd63cb5fcb44c12272c3b665cdb233725
Sep 04 22:15:49.379365 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:49.379306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx" event={"ID":"6b486dbd-39a5-45f5-b939-8ed4dc1894d6","Type":"ContainerStarted","Data":"a0b9d66daf3f41b021d8d0c8946d9ddcd63cb5fcb44c12272c3b665cdb233725"}
Sep 04 22:15:51.005396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.005362    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"]
Sep 04 22:15:51.008270 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.008250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.018335 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.018308    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 04 22:15:51.018437 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.018308    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 04 22:15:51.018437 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.018347    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 04 22:15:51.019199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.019176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 04 22:15:51.019321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.019178    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b4srj\""
Sep 04 22:15:51.037270 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.037247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"]
Sep 04 22:15:51.181636 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.181581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.181818 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.181642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.181818 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.181676    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.181818 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.181709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.181818 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.181745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.181818 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.181784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.182042 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.181873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgk5w\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-kube-api-access-mgk5w\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.282964 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.282885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.282964 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.282946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgk5w\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-kube-api-access-mgk5w\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.283156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.282997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.283156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.283024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.283156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.283045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.283156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.283065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.283156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.283098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.283881 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.283821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.285797 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.285770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.285895 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.285838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.285941 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.285889    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.285988 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.285961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.294210 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.294182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.294846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.294818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgk5w\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-kube-api-access-mgk5w\") pod \"istiod-openshift-gateway-7b7995d5cd-b8mv7\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.319025 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.319003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:51.662141 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:51.662117    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"]
Sep 04 22:15:51.664458 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:15:51.664431    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e4d59f_bafa_4070_8cbc_cb92fd7a0991.slice/crio-8d76acc8d492686819d7738caedaeda7b057947b032aab49c952e90a58e2b9c1 WatchSource:0}: Error finding container 8d76acc8d492686819d7738caedaeda7b057947b032aab49c952e90a58e2b9c1: Status 404 returned error can't find the container with id 8d76acc8d492686819d7738caedaeda7b057947b032aab49c952e90a58e2b9c1
Sep 04 22:15:52.393075 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:52.393042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7" event={"ID":"16e4d59f-bafa-4070-8cbc-cb92fd7a0991","Type":"ContainerStarted","Data":"8d76acc8d492686819d7738caedaeda7b057947b032aab49c952e90a58e2b9c1"}
Sep 04 22:15:52.394469 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:52.394440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx" event={"ID":"6b486dbd-39a5-45f5-b939-8ed4dc1894d6","Type":"ContainerStarted","Data":"5011db3fbe8fcdc02ab48614cc89714ee5f648c6a7c9990345de9d9809d20623"}
Sep 04 22:15:52.414051 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:52.413999    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7766956b67-gctsx" podStartSLOduration=2.673278415 podStartE2EDuration="5.41398152s" totalImagesPullingTime="2.740703105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:52.412713449 +0000 UTC m=+426.217070967" watchObservedRunningTime="2026-09-04 22:15:52.41398152 +0000 UTC m=+426.218339044"
Sep 04 22:15:54.263433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:54.263383    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:15:54.263848 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:54.263457    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:15:54.404248 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:54.404213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7" event={"ID":"16e4d59f-bafa-4070-8cbc-cb92fd7a0991","Type":"ContainerStarted","Data":"0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b"}
Sep 04 22:15:54.404396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:54.404308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:54.430178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:54.430122    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7" podStartSLOduration=1.833615675 podStartE2EDuration="4.430107036s" totalImagesPullingTime="2.596491361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:15:54.429267351 +0000 UTC m=+428.233624877" watchObservedRunningTime="2026-09-04 22:15:54.430107036 +0000 UTC m=+428.234464559"
Sep 04 22:15:55.410146 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.410105    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-b8mv7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:15:55.410474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.410170    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7" podUID="16e4d59f-bafa-4070-8cbc-cb92fd7a0991" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:15:55.715522 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.715452    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"]
Sep 04 22:15:55.719284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.719261    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.721675 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.721652    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9dfz5\""
Sep 04 22:15:55.730261 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.730239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"]
Sep 04 22:15:55.816595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.816781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.816781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.816781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.816913 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.816913 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.816913 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.817025 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.817025 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.816938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjvp4\" (UniqueName: \"kubernetes.io/projected/8bf7d554-9ff6-450f-a26d-7e4b6f085774-kube-api-access-hjvp4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.917684 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.917844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.917844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.917844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjvp4\" (UniqueName: \"kubernetes.io/projected/8bf7d554-9ff6-450f-a26d-7e4b6f085774-kube-api-access-hjvp4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.917844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.917844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918091 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918091 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918091 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.917963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918245 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.918187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918245 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.918218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.918361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.918620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.918709 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.918695    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.920124 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.920107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.920368 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.920344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.931232 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.931211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjvp4\" (UniqueName: \"kubernetes.io/projected/8bf7d554-9ff6-450f-a26d-7e4b6f085774-kube-api-access-hjvp4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:55.931339 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:55.931264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bf7d554-9ff6-450f-a26d-7e4b6f085774-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799crkv54\" (UID: \"8bf7d554-9ff6-450f-a26d-7e4b6f085774\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:56.029431 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:56.029369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:15:56.311715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:56.311686    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"]
Sep 04 22:15:56.314091 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:15:56.314067    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf7d554_9ff6_450f_a26d_7e4b6f085774.slice/crio-07b1cbf7958421b920ccd1f98ff432822c67d058a7e1ff28bcd0a3da8368d266 WatchSource:0}: Error finding container 07b1cbf7958421b920ccd1f98ff432822c67d058a7e1ff28bcd0a3da8368d266: Status 404 returned error can't find the container with id 07b1cbf7958421b920ccd1f98ff432822c67d058a7e1ff28bcd0a3da8368d266
Sep 04 22:15:56.413762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:56.413731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54" event={"ID":"8bf7d554-9ff6-450f-a26d-7e4b6f085774","Type":"ContainerStarted","Data":"07b1cbf7958421b920ccd1f98ff432822c67d058a7e1ff28bcd0a3da8368d266"}
Sep 04 22:15:57.907131 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:57.907093    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wdvm2"]
Sep 04 22:15:57.910886 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:57.910861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:57.913424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:57.913397    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 04 22:15:57.923319 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:57.923293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wdvm2"]
Sep 04 22:15:57.931229 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:57.931201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drdpj\" (UniqueName: \"kubernetes.io/projected/1dcead7a-20d4-4afe-b87d-f3524690abf5-kube-api-access-drdpj\") pod \"model-serving-api-54d89bd5fc-wdvm2\" (UID: \"1dcead7a-20d4-4afe-b87d-f3524690abf5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:57.931367 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:57.931341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dcead7a-20d4-4afe-b87d-f3524690abf5-tls-certs\") pod \"model-serving-api-54d89bd5fc-wdvm2\" (UID: \"1dcead7a-20d4-4afe-b87d-f3524690abf5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:58.031877 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:58.031845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dcead7a-20d4-4afe-b87d-f3524690abf5-tls-certs\") pod \"model-serving-api-54d89bd5fc-wdvm2\" (UID: \"1dcead7a-20d4-4afe-b87d-f3524690abf5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:58.032040 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:58.031892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drdpj\" (UniqueName: \"kubernetes.io/projected/1dcead7a-20d4-4afe-b87d-f3524690abf5-kube-api-access-drdpj\") pod \"model-serving-api-54d89bd5fc-wdvm2\" (UID: \"1dcead7a-20d4-4afe-b87d-f3524690abf5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:58.032040 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:15:58.032011    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 04 22:15:58.032148 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:15:58.032089    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcead7a-20d4-4afe-b87d-f3524690abf5-tls-certs podName:1dcead7a-20d4-4afe-b87d-f3524690abf5 nodeName:}" failed. No retries permitted until 2026-09-04 22:15:58.532067526 +0000 UTC m=+432.336425043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1dcead7a-20d4-4afe-b87d-f3524690abf5-tls-certs") pod "model-serving-api-54d89bd5fc-wdvm2" (UID: "1dcead7a-20d4-4afe-b87d-f3524690abf5") : secret "model-serving-api-tls" not found
Sep 04 22:15:58.042161 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:58.042135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drdpj\" (UniqueName: \"kubernetes.io/projected/1dcead7a-20d4-4afe-b87d-f3524690abf5-kube-api-access-drdpj\") pod \"model-serving-api-54d89bd5fc-wdvm2\" (UID: \"1dcead7a-20d4-4afe-b87d-f3524690abf5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:58.409978 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:58.409949    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:15:58.535074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:58.535034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dcead7a-20d4-4afe-b87d-f3524690abf5-tls-certs\") pod \"model-serving-api-54d89bd5fc-wdvm2\" (UID: \"1dcead7a-20d4-4afe-b87d-f3524690abf5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:58.537635 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:58.537589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dcead7a-20d4-4afe-b87d-f3524690abf5-tls-certs\") pod \"model-serving-api-54d89bd5fc-wdvm2\" (UID: \"1dcead7a-20d4-4afe-b87d-f3524690abf5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:58.825064 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:58.825031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:15:59.747998 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:59.747942    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:15:59.748392 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:59.748041    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:15:59.748392 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:59.748107    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:15:59.953979 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:15:59.953898    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wdvm2"]
Sep 04 22:15:59.957438 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:15:59.957403    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcead7a_20d4_4afe_b87d_f3524690abf5.slice/crio-9f66e03a760b2d0bf5d477553291dab418cd305a21964d1630af2910ea51e112 WatchSource:0}: Error finding container 9f66e03a760b2d0bf5d477553291dab418cd305a21964d1630af2910ea51e112: Status 404 returned error can't find the container with id 9f66e03a760b2d0bf5d477553291dab418cd305a21964d1630af2910ea51e112
Sep 04 22:16:00.431917 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:00.431877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2" event={"ID":"1dcead7a-20d4-4afe-b87d-f3524690abf5","Type":"ContainerStarted","Data":"9f66e03a760b2d0bf5d477553291dab418cd305a21964d1630af2910ea51e112"}
Sep 04 22:16:00.433400 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:00.433373    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54" event={"ID":"8bf7d554-9ff6-450f-a26d-7e4b6f085774","Type":"ContainerStarted","Data":"5eebccd384008b203b2812ef70d364ef068fcea847fabdeff9e65abc3f9f67f0"}
Sep 04 22:16:00.461380 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:00.461335    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54" podStartSLOduration=2.029752334 podStartE2EDuration="5.461321347s" totalImagesPullingTime="3.431569013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:16:00.459537824 +0000 UTC m=+434.263895349" watchObservedRunningTime="2026-09-04 22:16:00.461321347 +0000 UTC m=+434.265678871"
Sep 04 22:16:01.030153 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:01.030120    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:16:01.035362 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:01.035332    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:16:01.437079 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:01.437056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:16:01.437894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:01.437877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799crkv54"
Sep 04 22:16:02.442383 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:02.442350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2" event={"ID":"1dcead7a-20d4-4afe-b87d-f3524690abf5","Type":"ContainerStarted","Data":"084f1fef443145cffbfb9201426f76be51ede9a21d89e809a46d7b967175d6e6"}
Sep 04 22:16:02.442863 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:02.442439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:16:02.463067 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:02.463018    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2" podStartSLOduration=4.009629659 podStartE2EDuration="5.463002492s" totalImagesPullingTime="1.453372833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:16:02.461631579 +0000 UTC m=+436.265989105" watchObservedRunningTime="2026-09-04 22:16:02.463002492 +0000 UTC m=+436.267360016"
Sep 04 22:16:10.158421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.158332    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"]
Sep 04 22:16:10.161915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.161892    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.167852 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.167825    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-69h4f\""
Sep 04 22:16:10.167966 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.167864    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 04 22:16:10.190226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.190204    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"]
Sep 04 22:16:10.193233 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.193217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.196713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.196689    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 04 22:16:10.198459 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.198436    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"]
Sep 04 22:16:10.199388 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.199367    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n88vc\""
Sep 04 22:16:10.223437 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.223407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1ee3d7c-ec05-4cc4-baee-1464d26db8ba-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4qvj\" (UID: \"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.223562 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.223462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh2wg\" (UniqueName: \"kubernetes.io/projected/9e7dd329-086c-4588-adaf-5d9f1b494905-kube-api-access-rh2wg\") pod \"kserve-controller-manager-d6f4b65b8-2r9dp\" (UID: \"9e7dd329-086c-4588-adaf-5d9f1b494905\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.223562 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.223507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e7dd329-086c-4588-adaf-5d9f1b494905-cert\") pod \"kserve-controller-manager-d6f4b65b8-2r9dp\" (UID: \"9e7dd329-086c-4588-adaf-5d9f1b494905\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.223562 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.223544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcvnb\" (UniqueName: \"kubernetes.io/projected/d1ee3d7c-ec05-4cc4-baee-1464d26db8ba-kube-api-access-tcvnb\") pod \"llmisvc-controller-manager-777c6bd7d5-r4qvj\" (UID: \"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.228764 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.228742    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"]
Sep 04 22:16:10.324560 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.324525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1ee3d7c-ec05-4cc4-baee-1464d26db8ba-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4qvj\" (UID: \"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.324749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.324570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh2wg\" (UniqueName: \"kubernetes.io/projected/9e7dd329-086c-4588-adaf-5d9f1b494905-kube-api-access-rh2wg\") pod \"kserve-controller-manager-d6f4b65b8-2r9dp\" (UID: \"9e7dd329-086c-4588-adaf-5d9f1b494905\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.324749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.324621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e7dd329-086c-4588-adaf-5d9f1b494905-cert\") pod \"kserve-controller-manager-d6f4b65b8-2r9dp\" (UID: \"9e7dd329-086c-4588-adaf-5d9f1b494905\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.324749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.324648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcvnb\" (UniqueName: \"kubernetes.io/projected/d1ee3d7c-ec05-4cc4-baee-1464d26db8ba-kube-api-access-tcvnb\") pod \"llmisvc-controller-manager-777c6bd7d5-r4qvj\" (UID: \"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.326879 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.326854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e7dd329-086c-4588-adaf-5d9f1b494905-cert\") pod \"kserve-controller-manager-d6f4b65b8-2r9dp\" (UID: \"9e7dd329-086c-4588-adaf-5d9f1b494905\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.326975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.326916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1ee3d7c-ec05-4cc4-baee-1464d26db8ba-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4qvj\" (UID: \"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.335648 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.335592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh2wg\" (UniqueName: \"kubernetes.io/projected/9e7dd329-086c-4588-adaf-5d9f1b494905-kube-api-access-rh2wg\") pod \"kserve-controller-manager-d6f4b65b8-2r9dp\" (UID: \"9e7dd329-086c-4588-adaf-5d9f1b494905\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.336030 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.336014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcvnb\" (UniqueName: \"kubernetes.io/projected/d1ee3d7c-ec05-4cc4-baee-1464d26db8ba-kube-api-access-tcvnb\") pod \"llmisvc-controller-manager-777c6bd7d5-r4qvj\" (UID: \"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.472258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.472194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:10.504395 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.504363    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:10.701206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.701179    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"]
Sep 04 22:16:10.701373 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.701351    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7" podUID="16e4d59f-bafa-4070-8cbc-cb92fd7a0991" containerName="discovery" containerID="cri-o://0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b" gracePeriod=30
Sep 04 22:16:10.817878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.817847    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"]
Sep 04 22:16:10.834587 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:16:10.834544    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7dd329_086c_4588_adaf_5d9f1b494905.slice/crio-d7c59d708cbff705ca091d3025981f68277935e7313537234caea4f41d93d8b0 WatchSource:0}: Error finding container d7c59d708cbff705ca091d3025981f68277935e7313537234caea4f41d93d8b0: Status 404 returned error can't find the container with id d7c59d708cbff705ca091d3025981f68277935e7313537234caea4f41d93d8b0
Sep 04 22:16:10.847804 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.847585    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"]
Sep 04 22:16:10.849782 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:16:10.849756    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd1ee3d7c_ec05_4cc4_baee_1464d26db8ba.slice/crio-b18f264f422019c4c2fa39097b9e8fd0e69664f39e1ae03d67454451c76d563b WatchSource:0}: Error finding container b18f264f422019c4c2fa39097b9e8fd0e69664f39e1ae03d67454451c76d563b: Status 404 returned error can't find the container with id b18f264f422019c4c2fa39097b9e8fd0e69664f39e1ae03d67454451c76d563b
Sep 04 22:16:10.928139 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:10.928116    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:16:11.029910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.029852    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-local-certs\") pod \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") "
Sep 04 22:16:11.029910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.029886    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-cacerts\") pod \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") "
Sep 04 22:16:11.030050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.029942    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-kubeconfig\") pod \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") "
Sep 04 22:16:11.030050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.029976    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-dns-cert\") pod \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") "
Sep 04 22:16:11.030050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.030000    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-ca-configmap\") pod \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") "
Sep 04 22:16:11.030050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.030018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-token\") pod \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") "
Sep 04 22:16:11.030236 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.030054    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgk5w\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-kube-api-access-mgk5w\") pod \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\" (UID: \"16e4d59f-bafa-4070-8cbc-cb92fd7a0991\") "
Sep 04 22:16:11.030684 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.030647    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "16e4d59f-bafa-4070-8cbc-cb92fd7a0991" (UID: "16e4d59f-bafa-4070-8cbc-cb92fd7a0991"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:16:11.032666 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.032594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-cacerts" (OuterVolumeSpecName: "cacerts") pod "16e4d59f-bafa-4070-8cbc-cb92fd7a0991" (UID: "16e4d59f-bafa-4070-8cbc-cb92fd7a0991"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:16:11.032850 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.032808    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-local-certs" (OuterVolumeSpecName: "local-certs") pod "16e4d59f-bafa-4070-8cbc-cb92fd7a0991" (UID: "16e4d59f-bafa-4070-8cbc-cb92fd7a0991"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:16:11.033022 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.032894    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-kube-api-access-mgk5w" (OuterVolumeSpecName: "kube-api-access-mgk5w") pod "16e4d59f-bafa-4070-8cbc-cb92fd7a0991" (UID: "16e4d59f-bafa-4070-8cbc-cb92fd7a0991"). InnerVolumeSpecName "kube-api-access-mgk5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:16:11.033101 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.033033    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-token" (OuterVolumeSpecName: "istio-token") pod "16e4d59f-bafa-4070-8cbc-cb92fd7a0991" (UID: "16e4d59f-bafa-4070-8cbc-cb92fd7a0991"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:16:11.033280 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.033250    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "16e4d59f-bafa-4070-8cbc-cb92fd7a0991" (UID: "16e4d59f-bafa-4070-8cbc-cb92fd7a0991"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:16:11.034264 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.034246    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "16e4d59f-bafa-4070-8cbc-cb92fd7a0991" (UID: "16e4d59f-bafa-4070-8cbc-cb92fd7a0991"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:16:11.131338 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.131308    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-dns-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:16:11.131338 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.131335    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-csr-ca-configmap\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:16:11.131508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.131345    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:16:11.131508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.131354    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgk5w\" (UniqueName: \"kubernetes.io/projected/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-kube-api-access-mgk5w\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:16:11.131508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.131363    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-local-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:16:11.131508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.131371    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-cacerts\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:16:11.131508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.131378    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16e4d59f-bafa-4070-8cbc-cb92fd7a0991-istio-kubeconfig\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:16:11.480894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.480850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp" event={"ID":"9e7dd329-086c-4588-adaf-5d9f1b494905","Type":"ContainerStarted","Data":"d7c59d708cbff705ca091d3025981f68277935e7313537234caea4f41d93d8b0"}
Sep 04 22:16:11.482195 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.482170    2564 generic.go:356] "Generic (PLEG): container finished" podID="16e4d59f-bafa-4070-8cbc-cb92fd7a0991" containerID="0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b" exitCode=0
Sep 04 22:16:11.482319 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.482219    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"
Sep 04 22:16:11.482319 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.482248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7" event={"ID":"16e4d59f-bafa-4070-8cbc-cb92fd7a0991","Type":"ContainerDied","Data":"0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b"}
Sep 04 22:16:11.482319 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.482298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7" event={"ID":"16e4d59f-bafa-4070-8cbc-cb92fd7a0991","Type":"ContainerDied","Data":"8d76acc8d492686819d7738caedaeda7b057947b032aab49c952e90a58e2b9c1"}
Sep 04 22:16:11.482459 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.482337    2564 scope.go:117] "RemoveContainer" containerID="0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b"
Sep 04 22:16:11.483660 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.483636    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj" event={"ID":"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba","Type":"ContainerStarted","Data":"b18f264f422019c4c2fa39097b9e8fd0e69664f39e1ae03d67454451c76d563b"}
Sep 04 22:16:11.514068 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.514049    2564 scope.go:117] "RemoveContainer" containerID="0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b"
Sep 04 22:16:11.514408 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:16:11.514384    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b\": container with ID starting with 0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b not found: ID does not exist" containerID="0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b"
Sep 04 22:16:11.514489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.514419    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b"} err="failed to get container status \"0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b\": rpc error: code = NotFound desc = could not find container \"0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b\": container with ID starting with 0c4836309e09f555824b89e0410e96903d13956cd9400fd88f12154e66cfd67b not found: ID does not exist"
Sep 04 22:16:11.515421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.515400    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"]
Sep 04 22:16:11.520198 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:11.520179    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-b8mv7"]
Sep 04 22:16:12.673260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:12.673221    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e4d59f-bafa-4070-8cbc-cb92fd7a0991" path="/var/lib/kubelet/pods/16e4d59f-bafa-4070-8cbc-cb92fd7a0991/volumes"
Sep 04 22:16:13.452508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:13.452472    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wdvm2"
Sep 04 22:16:14.501151 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:14.501109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj" event={"ID":"d1ee3d7c-ec05-4cc4-baee-1464d26db8ba","Type":"ContainerStarted","Data":"a5783dd1d6d52a1670d696d8b0ba56bd349204a71ba46549edc2534cea1cc39e"}
Sep 04 22:16:14.501580 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:14.501260    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:14.502568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:14.502543    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp" event={"ID":"9e7dd329-086c-4588-adaf-5d9f1b494905","Type":"ContainerStarted","Data":"c4fd6475610f1c47300794f5ad231edbc189f6da6770635dbf3739ed160f5528"}
Sep 04 22:16:14.502704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:14.502657    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:16:14.597101 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:14.597047    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj" podStartSLOduration=1.781820929 podStartE2EDuration="4.597028419s" totalImagesPullingTime="2.81520749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:16:14.557277364 +0000 UTC m=+448.361634898" watchObservedRunningTime="2026-09-04 22:16:14.597028419 +0000 UTC m=+448.401385943"
Sep 04 22:16:14.598398 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:14.598358    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp" podStartSLOduration=1.771457289 podStartE2EDuration="4.598345299s" totalImagesPullingTime="2.82688801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:16:14.597309852 +0000 UTC m=+448.401667358" watchObservedRunningTime="2026-09-04 22:16:14.598345299 +0000 UTC m=+448.402702822"
Sep 04 22:16:45.509960 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:45.509929    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4qvj"
Sep 04 22:16:45.513312 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:16:45.513279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2r9dp"
Sep 04 22:17:15.497269 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.497208    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-h974l"]
Sep 04 22:17:15.497889 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.497624    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e4d59f-bafa-4070-8cbc-cb92fd7a0991" containerName="discovery"
Sep 04 22:17:15.497889 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.497641    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e4d59f-bafa-4070-8cbc-cb92fd7a0991" containerName="discovery"
Sep 04 22:17:15.497889 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.497714    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e4d59f-bafa-4070-8cbc-cb92fd7a0991" containerName="discovery"
Sep 04 22:17:15.500685 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.500668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-h974l"
Sep 04 22:17:15.504451 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.504427    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 04 22:17:15.504739 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.504703    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 04 22:17:15.504841 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.504817    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4w4pz\""
Sep 04 22:17:15.512000 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.511975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-h974l"]
Sep 04 22:17:15.519949 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.519923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m94k4\" (UniqueName: \"kubernetes.io/projected/91479ef6-b425-4732-8235-35632e3e1dbc-kube-api-access-m94k4\") pod \"authorino-operator-68d88948d8-h974l\" (UID: \"91479ef6-b425-4732-8235-35632e3e1dbc\") " pod="kuadrant-system/authorino-operator-68d88948d8-h974l"
Sep 04 22:17:15.621187 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.621154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m94k4\" (UniqueName: \"kubernetes.io/projected/91479ef6-b425-4732-8235-35632e3e1dbc-kube-api-access-m94k4\") pod \"authorino-operator-68d88948d8-h974l\" (UID: \"91479ef6-b425-4732-8235-35632e3e1dbc\") " pod="kuadrant-system/authorino-operator-68d88948d8-h974l"
Sep 04 22:17:15.634966 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.634928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m94k4\" (UniqueName: \"kubernetes.io/projected/91479ef6-b425-4732-8235-35632e3e1dbc-kube-api-access-m94k4\") pod \"authorino-operator-68d88948d8-h974l\" (UID: \"91479ef6-b425-4732-8235-35632e3e1dbc\") " pod="kuadrant-system/authorino-operator-68d88948d8-h974l"
Sep 04 22:17:15.811813 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:15.811725    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-h974l"
Sep 04 22:17:16.090499 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:16.090477    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-h974l"]
Sep 04 22:17:16.092702 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:17:16.092675    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91479ef6_b425_4732_8235_35632e3e1dbc.slice/crio-d35ddf0976b5791325482a860b74f54d99d316d614fa5e4a6d7df9e6d0469dd3 WatchSource:0}: Error finding container d35ddf0976b5791325482a860b74f54d99d316d614fa5e4a6d7df9e6d0469dd3: Status 404 returned error can't find the container with id d35ddf0976b5791325482a860b74f54d99d316d614fa5e4a6d7df9e6d0469dd3
Sep 04 22:17:16.755670 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:16.755635    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-h974l" event={"ID":"91479ef6-b425-4732-8235-35632e3e1dbc","Type":"ContainerStarted","Data":"d35ddf0976b5791325482a860b74f54d99d316d614fa5e4a6d7df9e6d0469dd3"}
Sep 04 22:17:17.726971 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:17.726937    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"]
Sep 04 22:17:17.730799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:17.730776    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:17.733725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:17.733706    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-p2nbz\""
Sep 04 22:17:17.739053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:17.739027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrxw\" (UniqueName: \"kubernetes.io/projected/0cad4775-31c5-48ae-aec6-2852cd83c76d-kube-api-access-2jrxw\") pod \"limitador-operator-controller-manager-6c549b6d85-lwwq8\" (UID: \"0cad4775-31c5-48ae-aec6-2852cd83c76d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:17.742561 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:17.742536    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"]
Sep 04 22:17:17.839816 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:17.839791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrxw\" (UniqueName: \"kubernetes.io/projected/0cad4775-31c5-48ae-aec6-2852cd83c76d-kube-api-access-2jrxw\") pod \"limitador-operator-controller-manager-6c549b6d85-lwwq8\" (UID: \"0cad4775-31c5-48ae-aec6-2852cd83c76d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:17.851715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:17.851685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrxw\" (UniqueName: \"kubernetes.io/projected/0cad4775-31c5-48ae-aec6-2852cd83c76d-kube-api-access-2jrxw\") pod \"limitador-operator-controller-manager-6c549b6d85-lwwq8\" (UID: \"0cad4775-31c5-48ae-aec6-2852cd83c76d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:18.043349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:18.043269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:19.225713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:19.225584    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"]
Sep 04 22:17:19.228395 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:17:19.228371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cad4775_31c5_48ae_aec6_2852cd83c76d.slice/crio-eb2edfff3b895bc1f96850db27bc66f90d9d90388b618bec194cab0d5c7b74a2 WatchSource:0}: Error finding container eb2edfff3b895bc1f96850db27bc66f90d9d90388b618bec194cab0d5c7b74a2: Status 404 returned error can't find the container with id eb2edfff3b895bc1f96850db27bc66f90d9d90388b618bec194cab0d5c7b74a2
Sep 04 22:17:19.772086 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:19.772045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-h974l" event={"ID":"91479ef6-b425-4732-8235-35632e3e1dbc","Type":"ContainerStarted","Data":"90989a37878b39f5667d7f17ee6dcdbe885a28d303c25b2c4551e93b1b12ba17"}
Sep 04 22:17:19.772281 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:19.772126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-h974l"
Sep 04 22:17:19.773435 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:19.773410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8" event={"ID":"0cad4775-31c5-48ae-aec6-2852cd83c76d","Type":"ContainerStarted","Data":"eb2edfff3b895bc1f96850db27bc66f90d9d90388b618bec194cab0d5c7b74a2"}
Sep 04 22:17:19.795017 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:19.794977    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-h974l" podStartSLOduration=1.864892151 podStartE2EDuration="4.794960407s" totalImagesPullingTime="2.930068256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:19.793792677 +0000 UTC m=+513.598150201" watchObservedRunningTime="2026-09-04 22:17:19.794960407 +0000 UTC m=+513.599317931"
Sep 04 22:17:21.787056 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:21.787020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8" event={"ID":"0cad4775-31c5-48ae-aec6-2852cd83c76d","Type":"ContainerStarted","Data":"0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2"}
Sep 04 22:17:21.787461 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:21.787132    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:21.834009 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:21.833924    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8" podStartSLOduration=3.187237716 podStartE2EDuration="4.833903015s" totalImagesPullingTime="1.646665299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:21.831869041 +0000 UTC m=+515.636226575" watchObservedRunningTime="2026-09-04 22:17:21.833903015 +0000 UTC m=+515.638260542"
Sep 04 22:17:22.158866 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.158831    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"]
Sep 04 22:17:22.162172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.162153    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.164680 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.164661    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7pnjv\""
Sep 04 22:17:22.172450 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.172428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7x6p\" (UniqueName: \"kubernetes.io/projected/87d4459d-b6b4-43f9-8c83-7a69e0237d96-kube-api-access-k7x6p\") pod \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.172546 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.172484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d4459d-b6b4-43f9-8c83-7a69e0237d96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.180623 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.180588    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"]
Sep 04 22:17:22.273094 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.273061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7x6p\" (UniqueName: \"kubernetes.io/projected/87d4459d-b6b4-43f9-8c83-7a69e0237d96-kube-api-access-k7x6p\") pod \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.273227 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.273123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d4459d-b6b4-43f9-8c83-7a69e0237d96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.273438 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.273423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d4459d-b6b4-43f9-8c83-7a69e0237d96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.286172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.286150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7x6p\" (UniqueName: \"kubernetes.io/projected/87d4459d-b6b4-43f9-8c83-7a69e0237d96-kube-api-access-k7x6p\") pod \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.471944 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.471872    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:22.752867 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.752842    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"]
Sep 04 22:17:22.754552 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:17:22.754532    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d4459d_b6b4_43f9_8c83_7a69e0237d96.slice/crio-b20146236845779bf94502590385388cbaf12f8e2acddb9a12c216fc846dec67 WatchSource:0}: Error finding container b20146236845779bf94502590385388cbaf12f8e2acddb9a12c216fc846dec67: Status 404 returned error can't find the container with id b20146236845779bf94502590385388cbaf12f8e2acddb9a12c216fc846dec67
Sep 04 22:17:22.796741 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:22.796707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz" event={"ID":"87d4459d-b6b4-43f9-8c83-7a69e0237d96","Type":"ContainerStarted","Data":"b20146236845779bf94502590385388cbaf12f8e2acddb9a12c216fc846dec67"}
Sep 04 22:17:26.816537 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:26.816502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz" event={"ID":"87d4459d-b6b4-43f9-8c83-7a69e0237d96","Type":"ContainerStarted","Data":"87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1"}
Sep 04 22:17:26.816914 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:26.816728    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:26.840346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:26.840300    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz" podStartSLOduration=1.123780979 podStartE2EDuration="4.840283876s" totalImagesPullingTime="3.716502897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:26.837989875 +0000 UTC m=+520.642347400" watchObservedRunningTime="2026-09-04 22:17:26.840283876 +0000 UTC m=+520.644641400"
Sep 04 22:17:29.126709 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.126672    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"]
Sep 04 22:17:29.130271 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.130255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.132685 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.132657    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 04 22:17:29.132685 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.132679    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bp59r\""
Sep 04 22:17:29.132896 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.132879    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 04 22:17:29.138568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.138542    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"]
Sep 04 22:17:29.235206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.235176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a7d3a74-980a-477a-bf9d-5972ed8409a4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.235359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.235220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lfd\" (UniqueName: \"kubernetes.io/projected/0a7d3a74-980a-477a-bf9d-5972ed8409a4-kube-api-access-q4lfd\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.235359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.235293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7d3a74-980a-477a-bf9d-5972ed8409a4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.336347 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.336316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a7d3a74-980a-477a-bf9d-5972ed8409a4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.336502 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.336363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lfd\" (UniqueName: \"kubernetes.io/projected/0a7d3a74-980a-477a-bf9d-5972ed8409a4-kube-api-access-q4lfd\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.336502 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.336401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7d3a74-980a-477a-bf9d-5972ed8409a4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.336963 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.336942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a7d3a74-980a-477a-bf9d-5972ed8409a4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.338773 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.338750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a7d3a74-980a-477a-bf9d-5972ed8409a4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.344644 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.344623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lfd\" (UniqueName: \"kubernetes.io/projected/0a7d3a74-980a-477a-bf9d-5972ed8409a4-kube-api-access-q4lfd\") pod \"kuadrant-console-plugin-598f86468b-qn56p\" (UID: \"0a7d3a74-980a-477a-bf9d-5972ed8409a4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.440095 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.440021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"
Sep 04 22:17:29.709831 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.709803    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p"]
Sep 04 22:17:29.711293 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:17:29.711264    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a7d3a74_980a_477a_bf9d_5972ed8409a4.slice/crio-415c20938604d7c1d867d7f536b81dd458a6bd202bd552b7f116fb479eb76185 WatchSource:0}: Error finding container 415c20938604d7c1d867d7f536b81dd458a6bd202bd552b7f116fb479eb76185: Status 404 returned error can't find the container with id 415c20938604d7c1d867d7f536b81dd458a6bd202bd552b7f116fb479eb76185
Sep 04 22:17:29.831314 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:29.831279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p" event={"ID":"0a7d3a74-980a-477a-bf9d-5972ed8409a4","Type":"ContainerStarted","Data":"415c20938604d7c1d867d7f536b81dd458a6bd202bd552b7f116fb479eb76185"}
Sep 04 22:17:30.783002 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:30.782968    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-h974l"
Sep 04 22:17:32.799835 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:32.799657    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:34.863507 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:34.863470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p" event={"ID":"0a7d3a74-980a-477a-bf9d-5972ed8409a4","Type":"ContainerStarted","Data":"d1d08258752f53924835ebbce12f11c6d49fbd4796d046b68f8d76a72566cb43"}
Sep 04 22:17:34.882347 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:34.882301    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-qn56p" podStartSLOduration=1.5802577869999999 podStartE2EDuration="5.882285927s" totalImagesPullingTime="4.30202814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:34.881429388 +0000 UTC m=+528.685786913" watchObservedRunningTime="2026-09-04 22:17:34.882285927 +0000 UTC m=+528.686643450"
Sep 04 22:17:37.823019 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:37.822986    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:40.381138 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.381057    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"]
Sep 04 22:17:40.381550 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.381249    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz" podUID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" containerName="manager" containerID="cri-o://87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1" gracePeriod=2
Sep 04 22:17:40.391761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.391735    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"]
Sep 04 22:17:40.460838 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.460792    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"]
Sep 04 22:17:40.461624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.461587    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" containerName="manager"
Sep 04 22:17:40.461624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.461626    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" containerName="manager"
Sep 04 22:17:40.461830 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.461815    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" containerName="manager"
Sep 04 22:17:40.466367 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.466338    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"]
Sep 04 22:17:40.467766 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.466437    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.467766 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.466801    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8" podUID="0cad4775-31c5-48ae-aec6-2852cd83c76d" containerName="manager" containerID="cri-o://0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2" gracePeriod=2
Sep 04 22:17:40.467766 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.467642    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"]
Sep 04 22:17:40.493542 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.493519    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"]
Sep 04 22:17:40.494087 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.494060    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cad4775-31c5-48ae-aec6-2852cd83c76d" containerName="manager"
Sep 04 22:17:40.494087 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.494085    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cad4775-31c5-48ae-aec6-2852cd83c76d" containerName="manager"
Sep 04 22:17:40.494195 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.494182    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cad4775-31c5-48ae-aec6-2852cd83c76d" containerName="manager"
Sep 04 22:17:40.497379 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.497359    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.498770 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:17:40.498746    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" is forbidden: User \"system:node:ip-10-0-139-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-255.ec2.internal' and this object" podUID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:40.501008 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:17:40.500984    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-lwwq8\" is forbidden: User \"system:node:ip-10-0-139-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-255.ec2.internal' and this object" podUID="0cad4775-31c5-48ae-aec6-2852cd83c76d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:40.535865 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.535836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"]
Sep 04 22:17:40.536319 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.536293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-4f66m\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.536490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.536343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fvs\" (UniqueName: \"kubernetes.io/projected/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-kube-api-access-p6fvs\") pod \"kuadrant-operator-controller-manager-58fc56757c-4f66m\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.550526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.550498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"]
Sep 04 22:17:40.616508 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:17:40.616464    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dz8kz\" is forbidden: User \"system:node:ip-10-0-139-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-255.ec2.internal' and this object" podUID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:40.637262 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.637189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe808153-1854-432f-abf4-625957a0af1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ql5mw\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.637262 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.637246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpws5\" (UniqueName: \"kubernetes.io/projected/fe808153-1854-432f-abf4-625957a0af1b-kube-api-access-bpws5\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ql5mw\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.637433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.637276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-4f66m\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.637433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.637304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fvs\" (UniqueName: \"kubernetes.io/projected/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-kube-api-access-p6fvs\") pod \"kuadrant-operator-controller-manager-58fc56757c-4f66m\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.637951 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.637931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-4f66m\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.661051 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.661024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fvs\" (UniqueName: \"kubernetes.io/projected/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-kube-api-access-p6fvs\") pod \"kuadrant-operator-controller-manager-58fc56757c-4f66m\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.700364 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.700340    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:40.703046 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.703029    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:40.738454 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.738424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe808153-1854-432f-abf4-625957a0af1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ql5mw\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.738530 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.738472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpws5\" (UniqueName: \"kubernetes.io/projected/fe808153-1854-432f-abf4-625957a0af1b-kube-api-access-bpws5\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ql5mw\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.738889 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.738865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe808153-1854-432f-abf4-625957a0af1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ql5mw\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.750268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.750247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpws5\" (UniqueName: \"kubernetes.io/projected/fe808153-1854-432f-abf4-625957a0af1b-kube-api-access-bpws5\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ql5mw\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.824786 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.824761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:40.837662 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.837640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:40.838801 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.838780    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d4459d-b6b4-43f9-8c83-7a69e0237d96-extensions-socket-volume\") pod \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") "
Sep 04 22:17:40.838891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.838823    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7x6p\" (UniqueName: \"kubernetes.io/projected/87d4459d-b6b4-43f9-8c83-7a69e0237d96-kube-api-access-k7x6p\") pod \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\" (UID: \"87d4459d-b6b4-43f9-8c83-7a69e0237d96\") "
Sep 04 22:17:40.838891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.838857    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrxw\" (UniqueName: \"kubernetes.io/projected/0cad4775-31c5-48ae-aec6-2852cd83c76d-kube-api-access-2jrxw\") pod \"0cad4775-31c5-48ae-aec6-2852cd83c76d\" (UID: \"0cad4775-31c5-48ae-aec6-2852cd83c76d\") "
Sep 04 22:17:40.839322 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.839286    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d4459d-b6b4-43f9-8c83-7a69e0237d96-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87d4459d-b6b4-43f9-8c83-7a69e0237d96" (UID: "87d4459d-b6b4-43f9-8c83-7a69e0237d96"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:40.841010 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.840978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d4459d-b6b4-43f9-8c83-7a69e0237d96-kube-api-access-k7x6p" (OuterVolumeSpecName: "kube-api-access-k7x6p") pod "87d4459d-b6b4-43f9-8c83-7a69e0237d96" (UID: "87d4459d-b6b4-43f9-8c83-7a69e0237d96"). InnerVolumeSpecName "kube-api-access-k7x6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:40.841100 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.841044    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cad4775-31c5-48ae-aec6-2852cd83c76d-kube-api-access-2jrxw" (OuterVolumeSpecName: "kube-api-access-2jrxw") pod "0cad4775-31c5-48ae-aec6-2852cd83c76d" (UID: "0cad4775-31c5-48ae-aec6-2852cd83c76d"). InnerVolumeSpecName "kube-api-access-2jrxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:40.895089 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.895053    2564 generic.go:356] "Generic (PLEG): container finished" podID="0cad4775-31c5-48ae-aec6-2852cd83c76d" containerID="0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2" exitCode=0
Sep 04 22:17:40.895214 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.895155    2564 scope.go:117] "RemoveContainer" containerID="0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2"
Sep 04 22:17:40.895351 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.895316    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-lwwq8"
Sep 04 22:17:40.897494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.897465    2564 generic.go:356] "Generic (PLEG): container finished" podID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" containerID="87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1" exitCode=0
Sep 04 22:17:40.897631 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.897618    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dz8kz"
Sep 04 22:17:40.906429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.906384    2564 scope.go:117] "RemoveContainer" containerID="0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2"
Sep 04 22:17:40.906858 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:17:40.906831    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2\": container with ID starting with 0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2 not found: ID does not exist" containerID="0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2"
Sep 04 22:17:40.906956 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.906870    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2"} err="failed to get container status \"0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2\": rpc error: code = NotFound desc = could not find container \"0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2\": container with ID starting with 0dee048b0b8b43a1d09bea951b68fc7d729ca71d7c601e3e43a98e20fb2a11a2 not found: ID does not exist"
Sep 04 22:17:40.906956 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.906895    2564 scope.go:117] "RemoveContainer" containerID="87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1"
Sep 04 22:17:40.915815 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.915789    2564 scope.go:117] "RemoveContainer" containerID="87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1"
Sep 04 22:17:40.916100 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:17:40.916080    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1\": container with ID starting with 87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1 not found: ID does not exist" containerID="87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1"
Sep 04 22:17:40.916160 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.916111    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1"} err="failed to get container status \"87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1\": rpc error: code = NotFound desc = could not find container \"87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1\": container with ID starting with 87c3a8d22e7c97d758f86bb5a71f069245b19776864817360be5a72a54a6d1f1 not found: ID does not exist"
Sep 04 22:17:40.939756 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.939733    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d4459d-b6b4-43f9-8c83-7a69e0237d96-extensions-socket-volume\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:17:40.939756 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.939756    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7x6p\" (UniqueName: \"kubernetes.io/projected/87d4459d-b6b4-43f9-8c83-7a69e0237d96-kube-api-access-k7x6p\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:17:40.939873 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:40.939767    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrxw\" (UniqueName: \"kubernetes.io/projected/0cad4775-31c5-48ae-aec6-2852cd83c76d-kube-api-access-2jrxw\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:17:41.112235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.112212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"]
Sep 04 22:17:41.114518 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:17:41.114487    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be47929_0cd4_4cd5_a3df_1e71fbcda4ba.slice/crio-17b07a16911747da9e80242c586ba4fb4e86ce77ffd1b6f7a6dbe84e9afab518 WatchSource:0}: Error finding container 17b07a16911747da9e80242c586ba4fb4e86ce77ffd1b6f7a6dbe84e9afab518: Status 404 returned error can't find the container with id 17b07a16911747da9e80242c586ba4fb4e86ce77ffd1b6f7a6dbe84e9afab518
Sep 04 22:17:41.133143 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.133121    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"]
Sep 04 22:17:41.136425 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:17:41.136404    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe808153_1854_432f_abf4_625957a0af1b.slice/crio-5a50be8477a6cabdd1859a5da76b55e7fe785509dbb80f48cf6ece9c1baa72dc WatchSource:0}: Error finding container 5a50be8477a6cabdd1859a5da76b55e7fe785509dbb80f48cf6ece9c1baa72dc: Status 404 returned error can't find the container with id 5a50be8477a6cabdd1859a5da76b55e7fe785509dbb80f48cf6ece9c1baa72dc
Sep 04 22:17:41.905990 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.905958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw" event={"ID":"fe808153-1854-432f-abf4-625957a0af1b","Type":"ContainerStarted","Data":"320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839"}
Sep 04 22:17:41.906424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.906020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:41.906424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.906056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw" event={"ID":"fe808153-1854-432f-abf4-625957a0af1b","Type":"ContainerStarted","Data":"5a50be8477a6cabdd1859a5da76b55e7fe785509dbb80f48cf6ece9c1baa72dc"}
Sep 04 22:17:41.907706 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.907681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m" event={"ID":"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba","Type":"ContainerStarted","Data":"01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e"}
Sep 04 22:17:41.907822 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.907719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m" event={"ID":"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba","Type":"ContainerStarted","Data":"17b07a16911747da9e80242c586ba4fb4e86ce77ffd1b6f7a6dbe84e9afab518"}
Sep 04 22:17:41.907822 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.907750    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:41.931384 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.931343    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw" podStartSLOduration=1.9313301969999999 podStartE2EDuration="1.931330197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:41.930782197 +0000 UTC m=+535.735139722" watchObservedRunningTime="2026-09-04 22:17:41.931330197 +0000 UTC m=+535.735687703"
Sep 04 22:17:41.954651 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:41.954590    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m" podStartSLOduration=1.9545750339999999 podStartE2EDuration="1.954575034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:41.952011673 +0000 UTC m=+535.756369197" watchObservedRunningTime="2026-09-04 22:17:41.954575034 +0000 UTC m=+535.758932557"
Sep 04 22:17:42.670734 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:42.670703    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cad4775-31c5-48ae-aec6-2852cd83c76d" path="/var/lib/kubelet/pods/0cad4775-31c5-48ae-aec6-2852cd83c76d/volumes"
Sep 04 22:17:42.671055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:42.671042    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d4459d-b6b4-43f9-8c83-7a69e0237d96" path="/var/lib/kubelet/pods/87d4459d-b6b4-43f9-8c83-7a69e0237d96/volumes"
Sep 04 22:17:52.915065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:52.915030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:17:52.915556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:52.915326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:53.035999 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.035961    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"]
Sep 04 22:17:53.036168 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.036148    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m" podUID="0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" containerName="manager" containerID="cri-o://01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e" gracePeriod=10
Sep 04 22:17:53.285129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.285104    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:53.420186 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.420150    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"]
Sep 04 22:17:53.420568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.420552    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" containerName="manager"
Sep 04 22:17:53.420568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.420569    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" containerName="manager"
Sep 04 22:17:53.420735 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.420642    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" containerName="manager"
Sep 04 22:17:53.426133 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.426112    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.441371 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.441347    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-extensions-socket-volume\") pod \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") "
Sep 04 22:17:53.441452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.441403    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6fvs\" (UniqueName: \"kubernetes.io/projected/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-kube-api-access-p6fvs\") pod \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\" (UID: \"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba\") "
Sep 04 22:17:53.441704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.441685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" (UID: "0be47929-0cd4-4cd5-a3df-1e71fbcda4ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:17:53.443193 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.443173    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-kube-api-access-p6fvs" (OuterVolumeSpecName: "kube-api-access-p6fvs") pod "0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" (UID: "0be47929-0cd4-4cd5-a3df-1e71fbcda4ba"). InnerVolumeSpecName "kube-api-access-p6fvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:17:53.450349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.450327    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"]
Sep 04 22:17:53.542379 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.542323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/989d45fa-221c-4e42-ba7d-d97a3774db87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-scnxn\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.542379 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.542363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rzq4\" (UniqueName: \"kubernetes.io/projected/989d45fa-221c-4e42-ba7d-d97a3774db87-kube-api-access-7rzq4\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-scnxn\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.542504 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.542417    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-extensions-socket-volume\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:17:53.542504 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.542429    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6fvs\" (UniqueName: \"kubernetes.io/projected/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba-kube-api-access-p6fvs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:17:53.643763 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.643735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rzq4\" (UniqueName: \"kubernetes.io/projected/989d45fa-221c-4e42-ba7d-d97a3774db87-kube-api-access-7rzq4\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-scnxn\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.644013 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.643993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/989d45fa-221c-4e42-ba7d-d97a3774db87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-scnxn\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.644496 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.644474    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/989d45fa-221c-4e42-ba7d-d97a3774db87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-scnxn\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.654733 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.654710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rzq4\" (UniqueName: \"kubernetes.io/projected/989d45fa-221c-4e42-ba7d-d97a3774db87-kube-api-access-7rzq4\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-scnxn\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.735745 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.735590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:53.970541 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.970506    2564 generic.go:356] "Generic (PLEG): container finished" podID="0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" containerID="01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e" exitCode=0
Sep 04 22:17:53.970955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.970580    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"
Sep 04 22:17:53.970955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.970608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m" event={"ID":"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba","Type":"ContainerDied","Data":"01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e"}
Sep 04 22:17:53.970955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.970755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m" event={"ID":"0be47929-0cd4-4cd5-a3df-1e71fbcda4ba","Type":"ContainerDied","Data":"17b07a16911747da9e80242c586ba4fb4e86ce77ffd1b6f7a6dbe84e9afab518"}
Sep 04 22:17:53.970955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.970789    2564 scope.go:117] "RemoveContainer" containerID="01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e"
Sep 04 22:17:53.979876 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.979852    2564 scope.go:117] "RemoveContainer" containerID="01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e"
Sep 04 22:17:53.980165 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:17:53.980144    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e\": container with ID starting with 01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e not found: ID does not exist" containerID="01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e"
Sep 04 22:17:53.980218 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.980175    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e"} err="failed to get container status \"01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e\": rpc error: code = NotFound desc = could not find container \"01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e\": container with ID starting with 01a46f7be9e59a45ec2c5fd1fa3c664c751ea0d1d90513f98c69a9cd8a23c91e not found: ID does not exist"
Sep 04 22:17:53.997283 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:53.997261    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"]
Sep 04 22:17:54.004782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:54.004762    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-4f66m"]
Sep 04 22:17:54.031718 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:54.031698    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"]
Sep 04 22:17:54.033771 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:17:54.033746    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989d45fa_221c_4e42_ba7d_d97a3774db87.slice/crio-53ef2074d3aca7282ff89d0303b7969d0eac47f6d9c58ade8d37dd43bbffd8af WatchSource:0}: Error finding container 53ef2074d3aca7282ff89d0303b7969d0eac47f6d9c58ade8d37dd43bbffd8af: Status 404 returned error can't find the container with id 53ef2074d3aca7282ff89d0303b7969d0eac47f6d9c58ade8d37dd43bbffd8af
Sep 04 22:17:54.671133 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:54.671092    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be47929-0cd4-4cd5-a3df-1e71fbcda4ba" path="/var/lib/kubelet/pods/0be47929-0cd4-4cd5-a3df-1e71fbcda4ba/volumes"
Sep 04 22:17:54.978725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:54.978633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn" event={"ID":"989d45fa-221c-4e42-ba7d-d97a3774db87","Type":"ContainerStarted","Data":"81c349b0a144a0c97c1135f98e23bf4745e3a8195cddd5b95643baa33988e2d7"}
Sep 04 22:17:54.978725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:54.978692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn" event={"ID":"989d45fa-221c-4e42-ba7d-d97a3774db87","Type":"ContainerStarted","Data":"53ef2074d3aca7282ff89d0303b7969d0eac47f6d9c58ade8d37dd43bbffd8af"}
Sep 04 22:17:54.979122 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:54.978746    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:17:55.024550 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:17:55.024504    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn" podStartSLOduration=2.024488915 podStartE2EDuration="2.024488915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:17:55.021578936 +0000 UTC m=+548.825936461" watchObservedRunningTime="2026-09-04 22:17:55.024488915 +0000 UTC m=+548.828846439"
Sep 04 22:18:05.986036 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:05.986007    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:18:06.040898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.040861    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"]
Sep 04 22:18:06.041184 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.041125    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw" podUID="fe808153-1854-432f-abf4-625957a0af1b" containerName="manager" containerID="cri-o://320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839" gracePeriod=10
Sep 04 22:18:06.285918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.285892    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:18:06.449657 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.449624    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe808153-1854-432f-abf4-625957a0af1b-extensions-socket-volume\") pod \"fe808153-1854-432f-abf4-625957a0af1b\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") "
Sep 04 22:18:06.449866 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.449696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpws5\" (UniqueName: \"kubernetes.io/projected/fe808153-1854-432f-abf4-625957a0af1b-kube-api-access-bpws5\") pod \"fe808153-1854-432f-abf4-625957a0af1b\" (UID: \"fe808153-1854-432f-abf4-625957a0af1b\") "
Sep 04 22:18:06.449985 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.449962    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe808153-1854-432f-abf4-625957a0af1b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe808153-1854-432f-abf4-625957a0af1b" (UID: "fe808153-1854-432f-abf4-625957a0af1b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:18:06.451540 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.451509    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe808153-1854-432f-abf4-625957a0af1b-kube-api-access-bpws5" (OuterVolumeSpecName: "kube-api-access-bpws5") pod "fe808153-1854-432f-abf4-625957a0af1b" (UID: "fe808153-1854-432f-abf4-625957a0af1b"). InnerVolumeSpecName "kube-api-access-bpws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:06.551149 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.551074    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe808153-1854-432f-abf4-625957a0af1b-extensions-socket-volume\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:06.551149 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:06.551101    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpws5\" (UniqueName: \"kubernetes.io/projected/fe808153-1854-432f-abf4-625957a0af1b-kube-api-access-bpws5\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:07.035196 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.035159    2564 generic.go:356] "Generic (PLEG): container finished" podID="fe808153-1854-432f-abf4-625957a0af1b" containerID="320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839" exitCode=0
Sep 04 22:18:07.035633 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.035205    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"
Sep 04 22:18:07.035633 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.035246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw" event={"ID":"fe808153-1854-432f-abf4-625957a0af1b","Type":"ContainerDied","Data":"320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839"}
Sep 04 22:18:07.035633 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.035292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw" event={"ID":"fe808153-1854-432f-abf4-625957a0af1b","Type":"ContainerDied","Data":"5a50be8477a6cabdd1859a5da76b55e7fe785509dbb80f48cf6ece9c1baa72dc"}
Sep 04 22:18:07.035633 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.035313    2564 scope.go:117] "RemoveContainer" containerID="320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839"
Sep 04 22:18:07.043525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.043360    2564 scope.go:117] "RemoveContainer" containerID="320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839"
Sep 04 22:18:07.043667 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:18:07.043641    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839\": container with ID starting with 320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839 not found: ID does not exist" containerID="320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839"
Sep 04 22:18:07.043718 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.043678    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839"} err="failed to get container status \"320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839\": rpc error: code = NotFound desc = could not find container \"320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839\": container with ID starting with 320b26243a808852c28beeda98f89c587d9b5b927f7dedf567108b0771b29839 not found: ID does not exist"
Sep 04 22:18:07.066664 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.066642    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"]
Sep 04 22:18:07.079300 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:07.079277    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ql5mw"]
Sep 04 22:18:08.671453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:08.671422    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe808153-1854-432f-abf4-625957a0af1b" path="/var/lib/kubelet/pods/fe808153-1854-432f-abf4-625957a0af1b/volumes"
Sep 04 22:18:09.449735 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.449705    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"]
Sep 04 22:18:09.450063 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.450051    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe808153-1854-432f-abf4-625957a0af1b" containerName="manager"
Sep 04 22:18:09.450110 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.450064    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe808153-1854-432f-abf4-625957a0af1b" containerName="manager"
Sep 04 22:18:09.450150 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.450118    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe808153-1854-432f-abf4-625957a0af1b" containerName="manager"
Sep 04 22:18:09.461860 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.461838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.464183 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.464156    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vxt7b\""
Sep 04 22:18:09.465685 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.465659    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"]
Sep 04 22:18:09.475882 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.475856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.475989 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.475897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd5acc36-1427-41ce-a8e3-935a99102710-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.475989 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.475970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.476102 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.476000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd5acc36-1427-41ce-a8e3-935a99102710-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.476102 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.476035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbfl\" (UniqueName: \"kubernetes.io/projected/cd5acc36-1427-41ce-a8e3-935a99102710-kube-api-access-9vbfl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.476102 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.476097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.476242 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.476130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd5acc36-1427-41ce-a8e3-935a99102710-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.476242 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.476169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.476309 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.476242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd5acc36-1427-41ce-a8e3-935a99102710-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbfl\" (UniqueName: \"kubernetes.io/projected/cd5acc36-1427-41ce-a8e3-935a99102710-kube-api-access-9vbfl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd5acc36-1427-41ce-a8e3-935a99102710-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd5acc36-1427-41ce-a8e3-935a99102710-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.577857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.578106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.578106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.577993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.578304 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.578281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd5acc36-1427-41ce-a8e3-935a99102710-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.579911 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.579884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd5acc36-1427-41ce-a8e3-935a99102710-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.579990 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.579971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd5acc36-1427-41ce-a8e3-935a99102710-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.585888 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.585866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd5acc36-1427-41ce-a8e3-935a99102710-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.586485 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.586467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbfl\" (UniqueName: \"kubernetes.io/projected/cd5acc36-1427-41ce-a8e3-935a99102710-kube-api-access-9vbfl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-k9dfx\" (UID: \"cd5acc36-1427-41ce-a8e3-935a99102710\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:09.772729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:09.772650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:10.050823 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:10.050799    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"]
Sep 04 22:18:10.052548 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:18:10.052522    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5acc36_1427_41ce_a8e3_935a99102710.slice/crio-4717f78a0eb8aad4918c63c813aba7ab174cda154813fbfa3f79539f5cf84dd6 WatchSource:0}: Error finding container 4717f78a0eb8aad4918c63c813aba7ab174cda154813fbfa3f79539f5cf84dd6: Status 404 returned error can't find the container with id 4717f78a0eb8aad4918c63c813aba7ab174cda154813fbfa3f79539f5cf84dd6
Sep 04 22:18:10.054995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:10.054943    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:18:10.055061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:10.055036    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:18:10.055103 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:10.055090    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:18:11.059339 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:11.059299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" event={"ID":"cd5acc36-1427-41ce-a8e3-935a99102710","Type":"ContainerStarted","Data":"3f3cd7fc2f1aa2f47518d051c74993cffb71d10015ab5b6101cd14bc8f45ff50"}
Sep 04 22:18:11.059769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:11.059364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" event={"ID":"cd5acc36-1427-41ce-a8e3-935a99102710","Type":"ContainerStarted","Data":"4717f78a0eb8aad4918c63c813aba7ab174cda154813fbfa3f79539f5cf84dd6"}
Sep 04 22:18:11.083701 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:11.083645    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" podStartSLOduration=2.083628728 podStartE2EDuration="2.083628728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:18:11.082367233 +0000 UTC m=+564.886724759" watchObservedRunningTime="2026-09-04 22:18:11.083628728 +0000 UTC m=+564.887986251"
Sep 04 22:18:11.773856 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:11.773816    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:11.778110 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:11.778084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:12.064395 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:12.064367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:12.065431 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:12.065416    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:18:23.811348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.811304    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"]
Sep 04 22:18:23.815119 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.815095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:23.817092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.817063    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 04 22:18:23.824473 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.824444    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"]
Sep 04 22:18:23.896978 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.896946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr4n4\" (UniqueName: \"kubernetes.io/projected/ce1ba79d-e0aa-429d-873d-2be74ff4de55-kube-api-access-sr4n4\") pod \"limitador-limitador-859c4d96d6-6fcr5\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:23.897125 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.896985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce1ba79d-e0aa-429d-873d-2be74ff4de55-config-file\") pod \"limitador-limitador-859c4d96d6-6fcr5\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:23.908616 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.908568    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"]
Sep 04 22:18:23.998155 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.998113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr4n4\" (UniqueName: \"kubernetes.io/projected/ce1ba79d-e0aa-429d-873d-2be74ff4de55-kube-api-access-sr4n4\") pod \"limitador-limitador-859c4d96d6-6fcr5\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:23.998350 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.998169    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce1ba79d-e0aa-429d-873d-2be74ff4de55-config-file\") pod \"limitador-limitador-859c4d96d6-6fcr5\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:23.998852 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:23.998825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce1ba79d-e0aa-429d-873d-2be74ff4de55-config-file\") pod \"limitador-limitador-859c4d96d6-6fcr5\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:24.008644 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.008563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr4n4\" (UniqueName: \"kubernetes.io/projected/ce1ba79d-e0aa-429d-873d-2be74ff4de55-kube-api-access-sr4n4\") pod \"limitador-limitador-859c4d96d6-6fcr5\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:24.127327 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.127295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:24.401324 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.401244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"]
Sep 04 22:18:24.404998 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:18:24.404970    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1ba79d_e0aa_429d_873d_2be74ff4de55.slice/crio-805afbf316d89b6fada02e5300fe8040dacb597da2cba09b41bbe8145b9597a0 WatchSource:0}: Error finding container 805afbf316d89b6fada02e5300fe8040dacb597da2cba09b41bbe8145b9597a0: Status 404 returned error can't find the container with id 805afbf316d89b6fada02e5300fe8040dacb597da2cba09b41bbe8145b9597a0
Sep 04 22:18:24.672366 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.672282    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-bstqh"]
Sep 04 22:18:24.676936 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.676913    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bstqh"
Sep 04 22:18:24.679199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.679172    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hl4x7\""
Sep 04 22:18:24.680911 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.680886    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bstqh"]
Sep 04 22:18:24.805859 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.805824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpv64\" (UniqueName: \"kubernetes.io/projected/f87cb25e-9da7-4044-a3f9-970d92152189-kube-api-access-tpv64\") pod \"authorino-b54df94b4-bstqh\" (UID: \"f87cb25e-9da7-4044-a3f9-970d92152189\") " pod="kuadrant-system/authorino-b54df94b4-bstqh"
Sep 04 22:18:24.806294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.806275    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-rzjjm"]
Sep 04 22:18:24.809667 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.809646    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-rzjjm"
Sep 04 22:18:24.817282 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.817261    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-rzjjm"]
Sep 04 22:18:24.906341 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.906311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpv64\" (UniqueName: \"kubernetes.io/projected/f87cb25e-9da7-4044-a3f9-970d92152189-kube-api-access-tpv64\") pod \"authorino-b54df94b4-bstqh\" (UID: \"f87cb25e-9da7-4044-a3f9-970d92152189\") " pod="kuadrant-system/authorino-b54df94b4-bstqh"
Sep 04 22:18:24.906489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.906362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vttpg\" (UniqueName: \"kubernetes.io/projected/d90e564c-dd8d-41ed-94b2-d0f8ce01b85a-kube-api-access-vttpg\") pod \"authorino-c548b5d7d-rzjjm\" (UID: \"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a\") " pod="kuadrant-system/authorino-c548b5d7d-rzjjm"
Sep 04 22:18:24.916184 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.916151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpv64\" (UniqueName: \"kubernetes.io/projected/f87cb25e-9da7-4044-a3f9-970d92152189-kube-api-access-tpv64\") pod \"authorino-b54df94b4-bstqh\" (UID: \"f87cb25e-9da7-4044-a3f9-970d92152189\") " pod="kuadrant-system/authorino-b54df94b4-bstqh"
Sep 04 22:18:24.987891 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:24.987828    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bstqh"
Sep 04 22:18:25.007870 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:25.007840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vttpg\" (UniqueName: \"kubernetes.io/projected/d90e564c-dd8d-41ed-94b2-d0f8ce01b85a-kube-api-access-vttpg\") pod \"authorino-c548b5d7d-rzjjm\" (UID: \"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a\") " pod="kuadrant-system/authorino-c548b5d7d-rzjjm"
Sep 04 22:18:25.018226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:25.018199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vttpg\" (UniqueName: \"kubernetes.io/projected/d90e564c-dd8d-41ed-94b2-d0f8ce01b85a-kube-api-access-vttpg\") pod \"authorino-c548b5d7d-rzjjm\" (UID: \"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a\") " pod="kuadrant-system/authorino-c548b5d7d-rzjjm"
Sep 04 22:18:25.119890 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:25.119857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-rzjjm"
Sep 04 22:18:25.125221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:25.125187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5" event={"ID":"ce1ba79d-e0aa-429d-873d-2be74ff4de55","Type":"ContainerStarted","Data":"805afbf316d89b6fada02e5300fe8040dacb597da2cba09b41bbe8145b9597a0"}
Sep 04 22:18:25.257053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:25.257029    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bstqh"]
Sep 04 22:18:25.258954 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:18:25.258923    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf87cb25e_9da7_4044_a3f9_970d92152189.slice/crio-0df6ddd7dc3ce7e4f3e4ce7c9001ab8da760b6bb3c7d13ea327e30f6062669c0 WatchSource:0}: Error finding container 0df6ddd7dc3ce7e4f3e4ce7c9001ab8da760b6bb3c7d13ea327e30f6062669c0: Status 404 returned error can't find the container with id 0df6ddd7dc3ce7e4f3e4ce7c9001ab8da760b6bb3c7d13ea327e30f6062669c0
Sep 04 22:18:25.390582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:25.390555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-rzjjm"]
Sep 04 22:18:25.392792 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:18:25.392761    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd90e564c_dd8d_41ed_94b2_d0f8ce01b85a.slice/crio-cc4a64c2be4fd3e8f6ca8cdc3a1085d17dd1b230cc4ca0f6e1bcfa259942cf15 WatchSource:0}: Error finding container cc4a64c2be4fd3e8f6ca8cdc3a1085d17dd1b230cc4ca0f6e1bcfa259942cf15: Status 404 returned error can't find the container with id cc4a64c2be4fd3e8f6ca8cdc3a1085d17dd1b230cc4ca0f6e1bcfa259942cf15
Sep 04 22:18:26.131712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:26.131665    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-rzjjm" event={"ID":"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a","Type":"ContainerStarted","Data":"cc4a64c2be4fd3e8f6ca8cdc3a1085d17dd1b230cc4ca0f6e1bcfa259942cf15"}
Sep 04 22:18:26.133079 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:26.133045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bstqh" event={"ID":"f87cb25e-9da7-4044-a3f9-970d92152189","Type":"ContainerStarted","Data":"0df6ddd7dc3ce7e4f3e4ce7c9001ab8da760b6bb3c7d13ea327e30f6062669c0"}
Sep 04 22:18:27.143353 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:27.143173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5" event={"ID":"ce1ba79d-e0aa-429d-873d-2be74ff4de55","Type":"ContainerStarted","Data":"ef27dc1c38face97652e46aff19ece53981694411df541090094642ade7f3f4a"}
Sep 04 22:18:27.143832 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:27.143503    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:27.163020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:27.162216    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5" podStartSLOduration=2.169284459 podStartE2EDuration="4.162192024s" totalImagesPullingTime="1.992907565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:18:27.15977819 +0000 UTC m=+580.964135715" watchObservedRunningTime="2026-09-04 22:18:27.162192024 +0000 UTC m=+580.966549550"
Sep 04 22:18:28.150658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:28.150594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bstqh" event={"ID":"f87cb25e-9da7-4044-a3f9-970d92152189","Type":"ContainerStarted","Data":"04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c"}
Sep 04 22:18:28.152134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:28.152110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-rzjjm" event={"ID":"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a","Type":"ContainerStarted","Data":"5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6"}
Sep 04 22:18:28.165881 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:28.165837    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-bstqh" podStartSLOduration=1.840472724 podStartE2EDuration="4.165822246s" totalImagesPullingTime="2.325349522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:18:28.164736741 +0000 UTC m=+581.969094266" watchObservedRunningTime="2026-09-04 22:18:28.165822246 +0000 UTC m=+581.970179770"
Sep 04 22:18:28.183569 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:28.183507    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-rzjjm" podStartSLOduration=1.9812565549999999 podStartE2EDuration="4.183485276s" totalImagesPullingTime="2.202228721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:18:28.180530871 +0000 UTC m=+581.984888412" watchObservedRunningTime="2026-09-04 22:18:28.183485276 +0000 UTC m=+581.987842800"
Sep 04 22:18:28.208825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:28.208791    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bstqh"]
Sep 04 22:18:30.163929 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:30.163882    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-bstqh" podUID="f87cb25e-9da7-4044-a3f9-970d92152189" containerName="authorino" containerID="cri-o://04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c" gracePeriod=30
Sep 04 22:18:30.413265 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:30.413234    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bstqh"
Sep 04 22:18:30.558886 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:30.558782    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpv64\" (UniqueName: \"kubernetes.io/projected/f87cb25e-9da7-4044-a3f9-970d92152189-kube-api-access-tpv64\") pod \"f87cb25e-9da7-4044-a3f9-970d92152189\" (UID: \"f87cb25e-9da7-4044-a3f9-970d92152189\") "
Sep 04 22:18:30.560884 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:30.560849    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87cb25e-9da7-4044-a3f9-970d92152189-kube-api-access-tpv64" (OuterVolumeSpecName: "kube-api-access-tpv64") pod "f87cb25e-9da7-4044-a3f9-970d92152189" (UID: "f87cb25e-9da7-4044-a3f9-970d92152189"). InnerVolumeSpecName "kube-api-access-tpv64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:30.660166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:30.660133    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpv64\" (UniqueName: \"kubernetes.io/projected/f87cb25e-9da7-4044-a3f9-970d92152189-kube-api-access-tpv64\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:31.169990 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.169953    2564 generic.go:356] "Generic (PLEG): container finished" podID="f87cb25e-9da7-4044-a3f9-970d92152189" containerID="04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c" exitCode=0
Sep 04 22:18:31.170452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.170013    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bstqh"
Sep 04 22:18:31.170452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.170031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bstqh" event={"ID":"f87cb25e-9da7-4044-a3f9-970d92152189","Type":"ContainerDied","Data":"04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c"}
Sep 04 22:18:31.170452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.170073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bstqh" event={"ID":"f87cb25e-9da7-4044-a3f9-970d92152189","Type":"ContainerDied","Data":"0df6ddd7dc3ce7e4f3e4ce7c9001ab8da760b6bb3c7d13ea327e30f6062669c0"}
Sep 04 22:18:31.170452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.170089    2564 scope.go:117] "RemoveContainer" containerID="04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c"
Sep 04 22:18:31.178393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.178371    2564 scope.go:117] "RemoveContainer" containerID="04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c"
Sep 04 22:18:31.178681 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:18:31.178666    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c\": container with ID starting with 04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c not found: ID does not exist" containerID="04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c"
Sep 04 22:18:31.178738 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.178689    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c"} err="failed to get container status \"04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c\": rpc error: code = NotFound desc = could not find container \"04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c\": container with ID starting with 04fdfd022944c4b8a578748a4f89d79c2fcdcbac0e72b99982e5b3f20149f37c not found: ID does not exist"
Sep 04 22:18:31.187661 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.187640    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bstqh"]
Sep 04 22:18:31.192336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:31.192316    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bstqh"]
Sep 04 22:18:32.671216 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:32.671178    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f87cb25e-9da7-4044-a3f9-970d92152189" path="/var/lib/kubelet/pods/f87cb25e-9da7-4044-a3f9-970d92152189/volumes"
Sep 04 22:18:37.671401 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:37.671365    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"]
Sep 04 22:18:37.671860 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:37.671559    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5" podUID="ce1ba79d-e0aa-429d-873d-2be74ff4de55" containerName="limitador" containerID="cri-o://ef27dc1c38face97652e46aff19ece53981694411df541090094642ade7f3f4a" gracePeriod=30
Sep 04 22:18:37.672238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:37.672217    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:38.205730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.205701    2564 generic.go:356] "Generic (PLEG): container finished" podID="ce1ba79d-e0aa-429d-873d-2be74ff4de55" containerID="ef27dc1c38face97652e46aff19ece53981694411df541090094642ade7f3f4a" exitCode=0
Sep 04 22:18:38.205838 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.205754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5" event={"ID":"ce1ba79d-e0aa-429d-873d-2be74ff4de55","Type":"ContainerDied","Data":"ef27dc1c38face97652e46aff19ece53981694411df541090094642ade7f3f4a"}
Sep 04 22:18:38.205838 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.205795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5" event={"ID":"ce1ba79d-e0aa-429d-873d-2be74ff4de55","Type":"ContainerDied","Data":"805afbf316d89b6fada02e5300fe8040dacb597da2cba09b41bbe8145b9597a0"}
Sep 04 22:18:38.205838 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.205817    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="805afbf316d89b6fada02e5300fe8040dacb597da2cba09b41bbe8145b9597a0"
Sep 04 22:18:38.212388 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.212368    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:38.329561 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.329530    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce1ba79d-e0aa-429d-873d-2be74ff4de55-config-file\") pod \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") "
Sep 04 22:18:38.329774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.329621    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr4n4\" (UniqueName: \"kubernetes.io/projected/ce1ba79d-e0aa-429d-873d-2be74ff4de55-kube-api-access-sr4n4\") pod \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\" (UID: \"ce1ba79d-e0aa-429d-873d-2be74ff4de55\") "
Sep 04 22:18:38.329957 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.329931    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1ba79d-e0aa-429d-873d-2be74ff4de55-config-file" (OuterVolumeSpecName: "config-file") pod "ce1ba79d-e0aa-429d-873d-2be74ff4de55" (UID: "ce1ba79d-e0aa-429d-873d-2be74ff4de55"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:18:38.331595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.331562    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1ba79d-e0aa-429d-873d-2be74ff4de55-kube-api-access-sr4n4" (OuterVolumeSpecName: "kube-api-access-sr4n4") pod "ce1ba79d-e0aa-429d-873d-2be74ff4de55" (UID: "ce1ba79d-e0aa-429d-873d-2be74ff4de55"). InnerVolumeSpecName "kube-api-access-sr4n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:38.430774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.430739    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce1ba79d-e0aa-429d-873d-2be74ff4de55-config-file\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:38.430774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:38.430767    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr4n4\" (UniqueName: \"kubernetes.io/projected/ce1ba79d-e0aa-429d-873d-2be74ff4de55-kube-api-access-sr4n4\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:39.210099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:39.210065    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"
Sep 04 22:18:39.227685 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:39.227655    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"]
Sep 04 22:18:39.234217 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:39.234191    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-6fcr5"]
Sep 04 22:18:40.670707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:40.670672    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1ba79d-e0aa-429d-873d-2be74ff4de55" path="/var/lib/kubelet/pods/ce1ba79d-e0aa-429d-873d-2be74ff4de55/volumes"
Sep 04 22:18:44.008949 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.008619    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"]
Sep 04 22:18:44.009424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.009157    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1ba79d-e0aa-429d-873d-2be74ff4de55" containerName="limitador"
Sep 04 22:18:44.009424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.009177    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1ba79d-e0aa-429d-873d-2be74ff4de55" containerName="limitador"
Sep 04 22:18:44.009424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.009192    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87cb25e-9da7-4044-a3f9-970d92152189" containerName="authorino"
Sep 04 22:18:44.009424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.009201    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87cb25e-9da7-4044-a3f9-970d92152189" containerName="authorino"
Sep 04 22:18:44.009424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.009294    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1ba79d-e0aa-429d-873d-2be74ff4de55" containerName="limitador"
Sep 04 22:18:44.009424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.009312    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f87cb25e-9da7-4044-a3f9-970d92152189" containerName="authorino"
Sep 04 22:18:44.012479 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.012450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.015285 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.015264    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 04 22:18:44.015949 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.015932    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7tfdd\""
Sep 04 22:18:44.015949 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.015944    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 04 22:18:44.016100 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.016008    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 04 22:18:44.023978 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.023957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"]
Sep 04 22:18:44.176390 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.176359    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98xkt\" (UniqueName: \"kubernetes.io/projected/e9d6bacd-2edf-4a99-be84-e99a957311b1-kube-api-access-98xkt\") pod \"postgres-69fb4594cf-jd9t5\" (UID: \"e9d6bacd-2edf-4a99-be84-e99a957311b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.176582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.176448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9d6bacd-2edf-4a99-be84-e99a957311b1-data\") pod \"postgres-69fb4594cf-jd9t5\" (UID: \"e9d6bacd-2edf-4a99-be84-e99a957311b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.276968 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.276886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98xkt\" (UniqueName: \"kubernetes.io/projected/e9d6bacd-2edf-4a99-be84-e99a957311b1-kube-api-access-98xkt\") pod \"postgres-69fb4594cf-jd9t5\" (UID: \"e9d6bacd-2edf-4a99-be84-e99a957311b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.277086 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.276962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9d6bacd-2edf-4a99-be84-e99a957311b1-data\") pod \"postgres-69fb4594cf-jd9t5\" (UID: \"e9d6bacd-2edf-4a99-be84-e99a957311b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.277313 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.277295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9d6bacd-2edf-4a99-be84-e99a957311b1-data\") pod \"postgres-69fb4594cf-jd9t5\" (UID: \"e9d6bacd-2edf-4a99-be84-e99a957311b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.286360 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.286345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98xkt\" (UniqueName: \"kubernetes.io/projected/e9d6bacd-2edf-4a99-be84-e99a957311b1-kube-api-access-98xkt\") pod \"postgres-69fb4594cf-jd9t5\" (UID: \"e9d6bacd-2edf-4a99-be84-e99a957311b1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.324991 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.324972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:44.597931 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:44.597903    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"]
Sep 04 22:18:44.599969 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:18:44.599941    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d6bacd_2edf_4a99_be84_e99a957311b1.slice/crio-ba28bf7a2c36d7f1729404c4157a99136e11902c94501b5224b18fb86681208c WatchSource:0}: Error finding container ba28bf7a2c36d7f1729404c4157a99136e11902c94501b5224b18fb86681208c: Status 404 returned error can't find the container with id ba28bf7a2c36d7f1729404c4157a99136e11902c94501b5224b18fb86681208c
Sep 04 22:18:45.239156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:45.239123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5" event={"ID":"e9d6bacd-2edf-4a99-be84-e99a957311b1","Type":"ContainerStarted","Data":"ba28bf7a2c36d7f1729404c4157a99136e11902c94501b5224b18fb86681208c"}
Sep 04 22:18:49.337768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:49.337738    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 04 22:18:50.266431 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:50.266389    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5" event={"ID":"e9d6bacd-2edf-4a99-be84-e99a957311b1","Type":"ContainerStarted","Data":"9fca87d58e8776334ad2067135f5d96043a4f7e8fb8651905b0a7ea9ca137d8c"}
Sep 04 22:18:50.266591 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:50.266533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:50.283665 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:50.283595    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5" podStartSLOduration=2.5498060369999997 podStartE2EDuration="7.283556153s" totalImagesPullingTime="4.733750116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:18:50.282353907 +0000 UTC m=+604.086711433" watchObservedRunningTime="2026-09-04 22:18:50.283556153 +0000 UTC m=+604.087913676"
Sep 04 22:18:56.300412 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.300383    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jd9t5"
Sep 04 22:18:56.830287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.830247    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-smgxk"]
Sep 04 22:18:56.836420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.836390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-smgxk"
Sep 04 22:18:56.842017 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.841992    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-smgxk"]
Sep 04 22:18:56.884939 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.884909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2clv\" (UniqueName: \"kubernetes.io/projected/229ed418-b290-4994-b7a5-f912b2dcae6b-kube-api-access-v2clv\") pod \"authorino-5dc7ccb5f-smgxk\" (UID: \"229ed418-b290-4994-b7a5-f912b2dcae6b\") " pod="kuadrant-system/authorino-5dc7ccb5f-smgxk"
Sep 04 22:18:56.897360 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.895781    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-smgxk"]
Sep 04 22:18:56.897360 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:18:56.896374    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-v2clv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-smgxk" podUID="229ed418-b290-4994-b7a5-f912b2dcae6b"
Sep 04 22:18:56.920422 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.920395    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-kk25w"]
Sep 04 22:18:56.924472 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.924455    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:56.927092 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.927074    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 04 22:18:56.934186 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.934166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-kk25w"]
Sep 04 22:18:56.985694 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.985658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2clv\" (UniqueName: \"kubernetes.io/projected/229ed418-b290-4994-b7a5-f912b2dcae6b-kube-api-access-v2clv\") pod \"authorino-5dc7ccb5f-smgxk\" (UID: \"229ed418-b290-4994-b7a5-f912b2dcae6b\") " pod="kuadrant-system/authorino-5dc7ccb5f-smgxk"
Sep 04 22:18:56.985813 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.985700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx2zl\" (UniqueName: \"kubernetes.io/projected/dce8713f-dd0b-400e-9e36-2e616f68d11b-kube-api-access-gx2zl\") pod \"authorino-687bd45585-kk25w\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") " pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:56.985813 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.985767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce8713f-dd0b-400e-9e36-2e616f68d11b-tls-cert\") pod \"authorino-687bd45585-kk25w\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") " pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:56.994310 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:56.994286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2clv\" (UniqueName: \"kubernetes.io/projected/229ed418-b290-4994-b7a5-f912b2dcae6b-kube-api-access-v2clv\") pod \"authorino-5dc7ccb5f-smgxk\" (UID: \"229ed418-b290-4994-b7a5-f912b2dcae6b\") " pod="kuadrant-system/authorino-5dc7ccb5f-smgxk"
Sep 04 22:18:57.080671 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.080586    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-kk25w"]
Sep 04 22:18:57.080897 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:18:57.080866    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gx2zl tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-kk25w" podUID="dce8713f-dd0b-400e-9e36-2e616f68d11b"
Sep 04 22:18:57.087105 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.087075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce8713f-dd0b-400e-9e36-2e616f68d11b-tls-cert\") pod \"authorino-687bd45585-kk25w\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") " pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:57.087232 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.087174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx2zl\" (UniqueName: \"kubernetes.io/projected/dce8713f-dd0b-400e-9e36-2e616f68d11b-kube-api-access-gx2zl\") pod \"authorino-687bd45585-kk25w\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") " pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:57.089406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.089372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce8713f-dd0b-400e-9e36-2e616f68d11b-tls-cert\") pod \"authorino-687bd45585-kk25w\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") " pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:57.097908 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.097876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx2zl\" (UniqueName: \"kubernetes.io/projected/dce8713f-dd0b-400e-9e36-2e616f68d11b-kube-api-access-gx2zl\") pod \"authorino-687bd45585-kk25w\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") " pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:57.299484 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.299449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:57.299697 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.299449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-smgxk"
Sep 04 22:18:57.307519 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.307500    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:57.310207 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.310193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-smgxk"
Sep 04 22:18:57.389679 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.389570    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx2zl\" (UniqueName: \"kubernetes.io/projected/dce8713f-dd0b-400e-9e36-2e616f68d11b-kube-api-access-gx2zl\") pod \"dce8713f-dd0b-400e-9e36-2e616f68d11b\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") "
Sep 04 22:18:57.389679 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.389654    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce8713f-dd0b-400e-9e36-2e616f68d11b-tls-cert\") pod \"dce8713f-dd0b-400e-9e36-2e616f68d11b\" (UID: \"dce8713f-dd0b-400e-9e36-2e616f68d11b\") "
Sep 04 22:18:57.389858 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.389700    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2clv\" (UniqueName: \"kubernetes.io/projected/229ed418-b290-4994-b7a5-f912b2dcae6b-kube-api-access-v2clv\") pod \"229ed418-b290-4994-b7a5-f912b2dcae6b\" (UID: \"229ed418-b290-4994-b7a5-f912b2dcae6b\") "
Sep 04 22:18:57.391806 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.391768    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dce8713f-dd0b-400e-9e36-2e616f68d11b-kube-api-access-gx2zl" (OuterVolumeSpecName: "kube-api-access-gx2zl") pod "dce8713f-dd0b-400e-9e36-2e616f68d11b" (UID: "dce8713f-dd0b-400e-9e36-2e616f68d11b"). InnerVolumeSpecName "kube-api-access-gx2zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:57.391806 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.391777    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dce8713f-dd0b-400e-9e36-2e616f68d11b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dce8713f-dd0b-400e-9e36-2e616f68d11b" (UID: "dce8713f-dd0b-400e-9e36-2e616f68d11b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:18:57.391953 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.391781    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229ed418-b290-4994-b7a5-f912b2dcae6b-kube-api-access-v2clv" (OuterVolumeSpecName: "kube-api-access-v2clv") pod "229ed418-b290-4994-b7a5-f912b2dcae6b" (UID: "229ed418-b290-4994-b7a5-f912b2dcae6b"). InnerVolumeSpecName "kube-api-access-v2clv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:18:57.491127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.491091    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2clv\" (UniqueName: \"kubernetes.io/projected/229ed418-b290-4994-b7a5-f912b2dcae6b-kube-api-access-v2clv\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:57.491127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.491122    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx2zl\" (UniqueName: \"kubernetes.io/projected/dce8713f-dd0b-400e-9e36-2e616f68d11b-kube-api-access-gx2zl\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:57.491127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:57.491132    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce8713f-dd0b-400e-9e36-2e616f68d11b-tls-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:18:58.303984 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.303952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kk25w"
Sep 04 22:18:58.304196 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.303952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-smgxk"
Sep 04 22:18:58.341851 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.341827    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-smgxk"]
Sep 04 22:18:58.344471 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.344448    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-smgxk"]
Sep 04 22:18:58.369817 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.369790    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-kk25w"]
Sep 04 22:18:58.374441 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.374411    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-kk25w"]
Sep 04 22:18:58.670595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.670562    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="229ed418-b290-4994-b7a5-f912b2dcae6b" path="/var/lib/kubelet/pods/229ed418-b290-4994-b7a5-f912b2dcae6b/volumes"
Sep 04 22:18:58.670851 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:58.670838    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dce8713f-dd0b-400e-9e36-2e616f68d11b" path="/var/lib/kubelet/pods/dce8713f-dd0b-400e-9e36-2e616f68d11b/volumes"
Sep 04 22:18:59.821052 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:59.821020    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-rzjjm"]
Sep 04 22:18:59.821559 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:18:59.821200    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-rzjjm" podUID="d90e564c-dd8d-41ed-94b2-d0f8ce01b85a" containerName="authorino" containerID="cri-o://5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6" gracePeriod=30
Sep 04 22:19:00.079477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.079408    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-rzjjm"
Sep 04 22:19:00.112046 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.112016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vttpg\" (UniqueName: \"kubernetes.io/projected/d90e564c-dd8d-41ed-94b2-d0f8ce01b85a-kube-api-access-vttpg\") pod \"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a\" (UID: \"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a\") "
Sep 04 22:19:00.113974 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.113942    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90e564c-dd8d-41ed-94b2-d0f8ce01b85a-kube-api-access-vttpg" (OuterVolumeSpecName: "kube-api-access-vttpg") pod "d90e564c-dd8d-41ed-94b2-d0f8ce01b85a" (UID: "d90e564c-dd8d-41ed-94b2-d0f8ce01b85a"). InnerVolumeSpecName "kube-api-access-vttpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:19:00.213303 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.213270    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vttpg\" (UniqueName: \"kubernetes.io/projected/d90e564c-dd8d-41ed-94b2-d0f8ce01b85a-kube-api-access-vttpg\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:19:00.314530 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.314493    2564 generic.go:356] "Generic (PLEG): container finished" podID="d90e564c-dd8d-41ed-94b2-d0f8ce01b85a" containerID="5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6" exitCode=0
Sep 04 22:19:00.314717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.314546    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-rzjjm"
Sep 04 22:19:00.314717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.314578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-rzjjm" event={"ID":"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a","Type":"ContainerDied","Data":"5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6"}
Sep 04 22:19:00.314717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.314628    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-rzjjm" event={"ID":"d90e564c-dd8d-41ed-94b2-d0f8ce01b85a","Type":"ContainerDied","Data":"cc4a64c2be4fd3e8f6ca8cdc3a1085d17dd1b230cc4ca0f6e1bcfa259942cf15"}
Sep 04 22:19:00.314717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.314652    2564 scope.go:117] "RemoveContainer" containerID="5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6"
Sep 04 22:19:00.323181 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.323165    2564 scope.go:117] "RemoveContainer" containerID="5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6"
Sep 04 22:19:00.323444 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:19:00.323426    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6\": container with ID starting with 5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6 not found: ID does not exist" containerID="5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6"
Sep 04 22:19:00.323512 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.323456    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6"} err="failed to get container status \"5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6\": rpc error: code = NotFound desc = could not find container \"5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6\": container with ID starting with 5f4fbd7d73b9b40cea509114d59438dbb8c0799e566eaaa8baaec846cd6388d6 not found: ID does not exist"
Sep 04 22:19:00.343822 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.343767    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-rzjjm"]
Sep 04 22:19:00.352857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.352831    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-rzjjm"]
Sep 04 22:19:00.671168 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:00.671090    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d90e564c-dd8d-41ed-94b2-d0f8ce01b85a" path="/var/lib/kubelet/pods/d90e564c-dd8d-41ed-94b2-d0f8ce01b85a/volumes"
Sep 04 22:19:05.128119 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.128085    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fwvzq"]
Sep 04 22:19:05.128626 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.128423    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90e564c-dd8d-41ed-94b2-d0f8ce01b85a" containerName="authorino"
Sep 04 22:19:05.128626 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.128434    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90e564c-dd8d-41ed-94b2-d0f8ce01b85a" containerName="authorino"
Sep 04 22:19:05.128626 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.128498    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d90e564c-dd8d-41ed-94b2-d0f8ce01b85a" containerName="authorino"
Sep 04 22:19:05.139492 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.139464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.140359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.140288    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fwvzq"]
Sep 04 22:19:05.141802 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.141766    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 04 22:19:05.141903 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.141853    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2nskt\""
Sep 04 22:19:05.142574 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.142546    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 04 22:19:05.142699 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.142549    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 04 22:19:05.155829 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.155803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.155939 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.155845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw8cz\" (UniqueName: \"kubernetes.io/projected/cf5382e6-c529-48a5-8075-bb7ed14a961f-kube-api-access-sw8cz\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.155939 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.155911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-metrics-certs\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.256785 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.256757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.256895 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.256791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw8cz\" (UniqueName: \"kubernetes.io/projected/cf5382e6-c529-48a5-8075-bb7ed14a961f-kube-api-access-sw8cz\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.256895 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.256811    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-metrics-certs\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.256983 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:19:05.256895    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 04 22:19:05.256983 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:19:05.256961    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert podName:cf5382e6-c529-48a5-8075-bb7ed14a961f nodeName:}" failed. No retries permitted until 2026-09-04 22:19:05.756945097 +0000 UTC m=+619.561302599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert") pod "maas-controller-7db7fc5975-fwvzq" (UID: "cf5382e6-c529-48a5-8075-bb7ed14a961f") : secret "maas-controller-webhook-cert" not found
Sep 04 22:19:05.259154 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.259138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-metrics-certs\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.265355 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.265335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw8cz\" (UniqueName: \"kubernetes.io/projected/cf5382e6-c529-48a5-8075-bb7ed14a961f-kube-api-access-sw8cz\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.760667 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.760623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:05.762988 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:05.762952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert\") pod \"maas-controller-7db7fc5975-fwvzq\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") " pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:06.050570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:06.050481    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:06.319161 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:06.319136    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fwvzq"]
Sep 04 22:19:06.321214 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:19:06.321182    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5382e6_c529_48a5_8075_bb7ed14a961f.slice/crio-95ec71dae407b0eeb9096c57e4f3b000cf6d61ea476a430a8ae2df0903769bd9 WatchSource:0}: Error finding container 95ec71dae407b0eeb9096c57e4f3b000cf6d61ea476a430a8ae2df0903769bd9: Status 404 returned error can't find the container with id 95ec71dae407b0eeb9096c57e4f3b000cf6d61ea476a430a8ae2df0903769bd9
Sep 04 22:19:06.344678 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:06.344650    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-fwvzq" event={"ID":"cf5382e6-c529-48a5-8075-bb7ed14a961f","Type":"ContainerStarted","Data":"95ec71dae407b0eeb9096c57e4f3b000cf6d61ea476a430a8ae2df0903769bd9"}
Sep 04 22:19:09.363172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:09.363133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-fwvzq" event={"ID":"cf5382e6-c529-48a5-8075-bb7ed14a961f","Type":"ContainerStarted","Data":"e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c"}
Sep 04 22:19:09.363533 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:09.363268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:09.384492 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:09.384443    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db7fc5975-fwvzq" podStartSLOduration=2.102762607 podStartE2EDuration="4.384430341s" totalImagesPullingTime="2.281667734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:19:09.382018094 +0000 UTC m=+623.186375620" watchObservedRunningTime="2026-09-04 22:19:09.384430341 +0000 UTC m=+623.188787865"
Sep 04 22:19:20.369820 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:20.369785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:19:42.345701 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.345663    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"]
Sep 04 22:19:42.349048 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.349027    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.351413 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.351394    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 04 22:19:42.352015 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.351998    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2lmrb\""
Sep 04 22:19:42.352101 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.352044    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 04 22:19:42.358882 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.358854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"]
Sep 04 22:19:42.473067 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.473028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-kube-api-access-2qxw4\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.473263 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.473099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-openshift-service-ca\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.473263 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.473162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-maas-api-tls\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.473359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.473284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-metrics-certs\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.574730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.574697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-openshift-service-ca\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.574900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.574743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-maas-api-tls\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.574900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.574784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-metrics-certs\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.574900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.574814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-kube-api-access-2qxw4\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.575638 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.575554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-openshift-service-ca\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.578971 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.578937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-metrics-certs\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.579152 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.579130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-maas-api-tls\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.583681 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.583652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-kube-api-access-2qxw4\") pod \"maas-api-6d9d77cfb4-kp9zf\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") " pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.659745 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.659659    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:42.892556 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.892522    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"]
Sep 04 22:19:42.896285 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.896257    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:42.898527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.898505    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 04 22:19:42.908568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.908545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"]
Sep 04 22:19:42.937537 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:42.937461    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"]
Sep 04 22:19:42.940889 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:19:42.940860    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad2ceb3_bc4e_4aad_94a9_8bf3528fec86.slice/crio-c0074ff4aa3ac321d553f2f0d55206e754e551a8fca9e25c35435c499dae6077 WatchSource:0}: Error finding container c0074ff4aa3ac321d553f2f0d55206e754e551a8fca9e25c35435c499dae6077: Status 404 returned error can't find the container with id c0074ff4aa3ac321d553f2f0d55206e754e551a8fca9e25c35435c499dae6077
Sep 04 22:19:43.079025 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.078992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be6867d-d712-4e19-b490-a0b7353ba6c0-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9f952\" (UID: \"2be6867d-d712-4e19-b490-a0b7353ba6c0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:43.079192 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.079099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmpzz\" (UniqueName: \"kubernetes.io/projected/2be6867d-d712-4e19-b490-a0b7353ba6c0-kube-api-access-nmpzz\") pod \"payload-pre-processing-59fbc47bf8-9f952\" (UID: \"2be6867d-d712-4e19-b490-a0b7353ba6c0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:43.180368 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.180328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmpzz\" (UniqueName: \"kubernetes.io/projected/2be6867d-d712-4e19-b490-a0b7353ba6c0-kube-api-access-nmpzz\") pod \"payload-pre-processing-59fbc47bf8-9f952\" (UID: \"2be6867d-d712-4e19-b490-a0b7353ba6c0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:43.180542 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.180424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be6867d-d712-4e19-b490-a0b7353ba6c0-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9f952\" (UID: \"2be6867d-d712-4e19-b490-a0b7353ba6c0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:43.183721 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.181645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2be6867d-d712-4e19-b490-a0b7353ba6c0-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9f952\" (UID: \"2be6867d-d712-4e19-b490-a0b7353ba6c0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:43.191489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.191436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmpzz\" (UniqueName: \"kubernetes.io/projected/2be6867d-d712-4e19-b490-a0b7353ba6c0-kube-api-access-nmpzz\") pod \"payload-pre-processing-59fbc47bf8-9f952\" (UID: \"2be6867d-d712-4e19-b490-a0b7353ba6c0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:43.207427 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.207402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:43.481443 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.481364    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"]
Sep 04 22:19:43.484401 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:19:43.484371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be6867d_d712_4e19_b490_a0b7353ba6c0.slice/crio-7d9273da40ca8a31c054d4ffe1b3056b629bec0382a332a8a19669cd3762f266 WatchSource:0}: Error finding container 7d9273da40ca8a31c054d4ffe1b3056b629bec0382a332a8a19669cd3762f266: Status 404 returned error can't find the container with id 7d9273da40ca8a31c054d4ffe1b3056b629bec0382a332a8a19669cd3762f266
Sep 04 22:19:43.523012 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.522964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952" event={"ID":"2be6867d-d712-4e19-b490-a0b7353ba6c0","Type":"ContainerStarted","Data":"7d9273da40ca8a31c054d4ffe1b3056b629bec0382a332a8a19669cd3762f266"}
Sep 04 22:19:43.524273 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:43.524247    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf" event={"ID":"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86","Type":"ContainerStarted","Data":"c0074ff4aa3ac321d553f2f0d55206e754e551a8fca9e25c35435c499dae6077"}
Sep 04 22:19:45.563522 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:45.563486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf" event={"ID":"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86","Type":"ContainerStarted","Data":"fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873"}
Sep 04 22:19:45.563993 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:45.563562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:45.582572 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:45.582510    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf" podStartSLOduration=1.501548059 podStartE2EDuration="3.582488863s" totalImagesPullingTime="2.080940804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:19:45.580871622 +0000 UTC m=+659.385229147" watchObservedRunningTime="2026-09-04 22:19:45.582488863 +0000 UTC m=+659.386846419"
Sep 04 22:19:46.570150 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:46.570107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952" event={"ID":"2be6867d-d712-4e19-b490-a0b7353ba6c0","Type":"ContainerStarted","Data":"41411f553c63f968045a7fd48e208f6885d2d69f9ae3a3796cd85cb3449d5077"}
Sep 04 22:19:46.570616 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:46.570337    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:46.591213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:46.591164    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952" podStartSLOduration=2.389955438 podStartE2EDuration="4.591149102s" totalImagesPullingTime="2.201193664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:19:46.589291795 +0000 UTC m=+660.393649322" watchObservedRunningTime="2026-09-04 22:19:46.591149102 +0000 UTC m=+660.395506630"
Sep 04 22:19:51.575911 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:51.575881    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:19:52.600340 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:52.600303    2564 generic.go:356] "Generic (PLEG): container finished" podID="cd5acc36-1427-41ce-a8e3-935a99102710" containerID="3f3cd7fc2f1aa2f47518d051c74993cffb71d10015ab5b6101cd14bc8f45ff50" exitCode=0
Sep 04 22:19:52.600799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:52.600377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" event={"ID":"cd5acc36-1427-41ce-a8e3-935a99102710","Type":"ContainerDied","Data":"3f3cd7fc2f1aa2f47518d051c74993cffb71d10015ab5b6101cd14bc8f45ff50"}
Sep 04 22:19:52.600799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:52.600784    2564 scope.go:117] "RemoveContainer" containerID="3f3cd7fc2f1aa2f47518d051c74993cffb71d10015ab5b6101cd14bc8f45ff50"
Sep 04 22:19:52.601794 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:52.601762    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:19:52.601871 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:52.601826    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:19:52.601871 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:52.601859    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:19:53.606773 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:53.606738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" event={"ID":"cd5acc36-1427-41ce-a8e3-935a99102710","Type":"ContainerStarted","Data":"92a547e2133a48c9dc827338850b49761100a46cf9ed0aba45e9e560e27d4e3b"}
Sep 04 22:19:53.773011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:53.772974    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:19:53.773933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:53.773907    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-k9dfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 04 22:19:53.774013 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:53.773955    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" podUID="cd5acc36-1427-41ce-a8e3-935a99102710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 04 22:19:54.773448 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:54.773407    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-k9dfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 04 22:19:54.773984 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:54.773484    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" podUID="cd5acc36-1427-41ce-a8e3-935a99102710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 04 22:19:55.773713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:55.773681    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-k9dfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 04 22:19:55.774071 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:55.773733    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" podUID="cd5acc36-1427-41ce-a8e3-935a99102710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 04 22:19:56.773396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:56.773357    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-k9dfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 04 22:19:56.773566 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:56.773438    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" podUID="cd5acc36-1427-41ce-a8e3-935a99102710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 04 22:19:57.064589 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:57.064566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:19:57.576751 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:57.576718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9f952"
Sep 04 22:19:57.773204 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:57.773164    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-k9dfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 04 22:19:57.773364 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:57.773222    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx" podUID="cd5acc36-1427-41ce-a8e3-935a99102710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 04 22:19:58.776877 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:58.776839    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:19:58.777778 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:19:58.777757    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-k9dfx"
Sep 04 22:20:05.985577 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:05.985540    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"]
Sep 04 22:20:05.988055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:05.988037    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:05.990867 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:05.990841    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 04 22:20:05.990971 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:05.990878    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 04 22:20:05.990971 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:05.990843    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 04 22:20:05.990971 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:05.990856    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tsxvl\""
Sep 04 22:20:06.001565 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.001544    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"]
Sep 04 22:20:06.067939 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.067909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.068087 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.067948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/902f9e41-8e00-46a3-99c6-2497e832bcd8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.068087 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.067974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.068087 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.068045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4dq\" (UniqueName: \"kubernetes.io/projected/902f9e41-8e00-46a3-99c6-2497e832bcd8-kube-api-access-sj4dq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.068195 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.068086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.068195 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.068142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169152 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/902f9e41-8e00-46a3-99c6-2497e832bcd8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4dq\" (UniqueName: \"kubernetes.io/projected/902f9e41-8e00-46a3-99c6-2497e832bcd8-kube-api-access-sj4dq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169673 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169735 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.169735 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.169686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.171620 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.171577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/902f9e41-8e00-46a3-99c6-2497e832bcd8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.171743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.171725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/902f9e41-8e00-46a3-99c6-2497e832bcd8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.177810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.177787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4dq\" (UniqueName: \"kubernetes.io/projected/902f9e41-8e00-46a3-99c6-2497e832bcd8-kube-api-access-sj4dq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6\" (UID: \"902f9e41-8e00-46a3-99c6-2497e832bcd8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.298889 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.298809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:06.574283 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.574257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"]
Sep 04 22:20:06.576033 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:20:06.576003    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902f9e41_8e00_46a3_99c6_2497e832bcd8.slice/crio-b8b67fd9223b5b2e5a46c2c16e97d26add2725b391da732f53dbbe89d5787400 WatchSource:0}: Error finding container b8b67fd9223b5b2e5a46c2c16e97d26add2725b391da732f53dbbe89d5787400: Status 404 returned error can't find the container with id b8b67fd9223b5b2e5a46c2c16e97d26add2725b391da732f53dbbe89d5787400
Sep 04 22:20:06.577327 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.577311    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:20:06.676846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:06.676812    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6" event={"ID":"902f9e41-8e00-46a3-99c6-2497e832bcd8","Type":"ContainerStarted","Data":"b8b67fd9223b5b2e5a46c2c16e97d26add2725b391da732f53dbbe89d5787400"}
Sep 04 22:20:08.689488 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:08.689455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6" event={"ID":"902f9e41-8e00-46a3-99c6-2497e832bcd8","Type":"ContainerStarted","Data":"ae9922cebbbf784843e5158d8ad1fb7a6e9187ede2be36f61de6516a8cfcf65f"}
Sep 04 22:20:08.709104 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:08.709049    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6" podStartSLOduration=2.622926508 podStartE2EDuration="3.709035385s" totalImagesPullingTime="1.086108877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:20:08.707652374 +0000 UTC m=+682.512009900" watchObservedRunningTime="2026-09-04 22:20:08.709035385 +0000 UTC m=+682.513392908"
Sep 04 22:20:16.299402 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:16.299373    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:16.299963 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:16.299592    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:16.312147 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:16.312124    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:16.738973 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:16.738939    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6"
Sep 04 22:20:49.784279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.784245    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"]
Sep 04 22:20:49.788446 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.788429    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.790810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.790785    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 04 22:20:49.800483 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.800456    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"]
Sep 04 22:20:49.846368 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.846332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.846529 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.846376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.846529 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.846450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqz4v\" (UniqueName: \"kubernetes.io/projected/8494ce7b-8b97-455c-ab2c-14e7a067774b-kube-api-access-kqz4v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.846529 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.846507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.846650 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.846536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.846650 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.846580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8494ce7b-8b97-455c-ab2c-14e7a067774b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947116 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqz4v\" (UniqueName: \"kubernetes.io/projected/8494ce7b-8b97-455c-ab2c-14e7a067774b-kube-api-access-kqz4v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947116 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947341 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947285    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947417 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8494ce7b-8b97-455c-ab2c-14e7a067774b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947481 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947481 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947588 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947694 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.947923 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.947902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.949662 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.949641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8494ce7b-8b97-455c-ab2c-14e7a067774b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.950079 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.950062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8494ce7b-8b97-455c-ab2c-14e7a067774b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:49.955771 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:49.955751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqz4v\" (UniqueName: \"kubernetes.io/projected/8494ce7b-8b97-455c-ab2c-14e7a067774b-kube-api-access-kqz4v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vg794\" (UID: \"8494ce7b-8b97-455c-ab2c-14e7a067774b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:50.099845 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:50.099808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:20:50.376084 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:50.376050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"]
Sep 04 22:20:50.378400 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:20:50.378368    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8494ce7b_8b97_455c_ab2c_14e7a067774b.slice/crio-ccc2a2549648e223c309926c4bbefebff86d34d0ebbe7fbe35b9024fd0529fea WatchSource:0}: Error finding container ccc2a2549648e223c309926c4bbefebff86d34d0ebbe7fbe35b9024fd0529fea: Status 404 returned error can't find the container with id ccc2a2549648e223c309926c4bbefebff86d34d0ebbe7fbe35b9024fd0529fea
Sep 04 22:20:50.896862 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:50.896825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794" event={"ID":"8494ce7b-8b97-455c-ab2c-14e7a067774b","Type":"ContainerStarted","Data":"dbf3dd962ca256bb09d694ef854febe45e4ff2ed3e418befe074337743a082df"}
Sep 04 22:20:50.897291 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:50.896885    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794" event={"ID":"8494ce7b-8b97-455c-ab2c-14e7a067774b","Type":"ContainerStarted","Data":"ccc2a2549648e223c309926c4bbefebff86d34d0ebbe7fbe35b9024fd0529fea"}
Sep 04 22:20:50.917289 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:20:50.917233    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794" podStartSLOduration=1.7402627960000001 podStartE2EDuration="1.917214635s" totalImagesPullingTime="176.951839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:20:50.91515569 +0000 UTC m=+724.719513216" watchObservedRunningTime="2026-09-04 22:20:50.917214635 +0000 UTC m=+724.721572160"
Sep 04 22:21:00.100407 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:00.100366    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:21:00.100910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:00.100437    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:21:00.113002 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:00.112975    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:21:00.959642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:00.959611    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vg794"
Sep 04 22:21:18.304551 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.304510    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"]
Sep 04 22:21:18.308320 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.308297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.310568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.310545    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 04 22:21:18.318116 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.318094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"]
Sep 04 22:21:18.400719 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.400694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba339f24-58c5-49c2-9a71-80c0bfd69587-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.400872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.400726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.400872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.400751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwvl\" (UniqueName: \"kubernetes.io/projected/ba339f24-58c5-49c2-9a71-80c0bfd69587-kube-api-access-qxwvl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.400872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.400829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.401017 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.400871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.401017 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.400917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502374 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502528 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba339f24-58c5-49c2-9a71-80c0bfd69587-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502528 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502528 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwvl\" (UniqueName: \"kubernetes.io/projected/ba339f24-58c5-49c2-9a71-80c0bfd69587-kube-api-access-qxwvl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502528 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.502946 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.502915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.504793 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.504775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba339f24-58c5-49c2-9a71-80c0bfd69587-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.504921 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.504905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba339f24-58c5-49c2-9a71-80c0bfd69587-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.511580 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.511557    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwvl\" (UniqueName: \"kubernetes.io/projected/ba339f24-58c5-49c2-9a71-80c0bfd69587-kube-api-access-qxwvl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dv7fk\" (UID: \"ba339f24-58c5-49c2-9a71-80c0bfd69587\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.620609 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.620578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:18.893494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:18.893447    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"]
Sep 04 22:21:18.895982 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:21:18.895956    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba339f24_58c5_49c2_9a71_80c0bfd69587.slice/crio-e720bd6e7f065074c182946223a17d659a3c41af484d25ce5fbf36d25c4e9d92 WatchSource:0}: Error finding container e720bd6e7f065074c182946223a17d659a3c41af484d25ce5fbf36d25c4e9d92: Status 404 returned error can't find the container with id e720bd6e7f065074c182946223a17d659a3c41af484d25ce5fbf36d25c4e9d92
Sep 04 22:21:19.040367 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:19.040333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk" event={"ID":"ba339f24-58c5-49c2-9a71-80c0bfd69587","Type":"ContainerStarted","Data":"e720bd6e7f065074c182946223a17d659a3c41af484d25ce5fbf36d25c4e9d92"}
Sep 04 22:21:20.048941 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:20.048909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk" event={"ID":"ba339f24-58c5-49c2-9a71-80c0bfd69587","Type":"ContainerStarted","Data":"6e07bab770a26b8ab6fca7fc84f2832f4982329ecef3c78af11250d64264eb4a"}
Sep 04 22:21:20.071483 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:20.071430    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk" podStartSLOduration=1.907459365 podStartE2EDuration="2.071413823s" totalImagesPullingTime="163.954458ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:21:20.068697796 +0000 UTC m=+753.873055319" watchObservedRunningTime="2026-09-04 22:21:20.071413823 +0000 UTC m=+753.875771346"
Sep 04 22:21:28.621425 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:28.621385    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:28.621873 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:28.621454    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:28.635102 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:28.635076    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:21:29.102805 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:21:29.102778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dv7fk"
Sep 04 22:22:43.568386 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.568353    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"]
Sep 04 22:22:43.571922 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.571901    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.575316 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.575296    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d9f7ae-openshift-default-dockercfg-krt9s\""
Sep 04 22:22:43.586544 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.586518    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"]
Sep 04 22:22:43.631968 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.631936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-podinfo\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.631973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-data\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.632002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-socket\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.632079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-token\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.632119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khch7\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-kube-api-access-khch7\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.632147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b7af99-a653-4b1f-8165-6a1b6448b972-istiod-ca-cert\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.632187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-certs\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.632227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-envoy\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.632349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.632267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-credential-socket\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.732727 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.732694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-credential-socket\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.732907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.732825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-podinfo\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.732907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.732849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-data\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.732907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.732879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-socket\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.732907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.732906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-token\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.733129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.732985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khch7\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-kube-api-access-khch7\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.733129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.733016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b7af99-a653-4b1f-8165-6a1b6448b972-istiod-ca-cert\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.733129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.733044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-certs\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.733129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.733062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-envoy\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.733932 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.733883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-socket\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.734049 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.733927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-certs\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.734179 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.734150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b7af99-a653-4b1f-8165-6a1b6448b972-istiod-ca-cert\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.734293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.734205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-credential-socket\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.734293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.734286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-data\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.736009 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.735986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-podinfo\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.736301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.736280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-envoy\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.743741 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.743717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-token\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.745565 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.745526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khch7\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-kube-api-access-khch7\") pod \"e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") " pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:43.882048 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:43.881965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:44.170508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.170480    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"]
Sep 04 22:22:44.173036 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:22:44.173009    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b7af99_a653_4b1f_8165_6a1b6448b972.slice/crio-14bb9ba72c01f8b098834d4e0654e90c3a70060373cdc5387ebf495aa48b3963 WatchSource:0}: Error finding container 14bb9ba72c01f8b098834d4e0654e90c3a70060373cdc5387ebf495aa48b3963: Status 404 returned error can't find the container with id 14bb9ba72c01f8b098834d4e0654e90c3a70060373cdc5387ebf495aa48b3963
Sep 04 22:22:44.175251 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.175218    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:22:44.175318 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.175283    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:22:44.175318 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.175311    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:22:44.454585 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.454496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" event={"ID":"58b7af99-a653-4b1f-8165-6a1b6448b972","Type":"ContainerStarted","Data":"3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b"}
Sep 04 22:22:44.454585 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.454557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" event={"ID":"58b7af99-a653-4b1f-8165-6a1b6448b972","Type":"ContainerStarted","Data":"14bb9ba72c01f8b098834d4e0654e90c3a70060373cdc5387ebf495aa48b3963"}
Sep 04 22:22:44.479829 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.479775    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podStartSLOduration=1.479756729 podStartE2EDuration="1.479756729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:22:44.479582375 +0000 UTC m=+838.283939913" watchObservedRunningTime="2026-09-04 22:22:44.479756729 +0000 UTC m=+838.284114254"
Sep 04 22:22:44.882570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:44.882532    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:45.887001 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:45.886960    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:46.464342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:46.464312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:46.465226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:46.465207    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:22:47.826127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.826098    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"]
Sep 04 22:22:47.829547 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.829528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.832285 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.832262    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d9f7ae-serving-cert\""
Sep 04 22:22:47.844806 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.844773    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"]
Sep 04 22:22:47.872446 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.872417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxhfw\" (UniqueName: \"kubernetes.io/projected/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-kube-api-access-pxhfw\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.872621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.872481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-metrics-certs\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.872621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.872575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.872731 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.872702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.973789 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.973751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.973948 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.973842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.973948 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.973916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxhfw\" (UniqueName: \"kubernetes.io/projected/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-kube-api-access-pxhfw\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.973948 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:22:47.973920    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-serving-cert: secret "maas-api-e2e-inf-a-d9f7ae-serving-cert" not found
Sep 04 22:22:47.974108 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.973962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-metrics-certs\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.974108 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:22:47.974017    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls podName:3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9 nodeName:}" failed. No retries permitted until 2026-09-04 22:22:48.473974388 +0000 UTC m=+842.278331890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls") pod "maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk" (UID: "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9") : secret "maas-api-e2e-inf-a-d9f7ae-serving-cert" not found
Sep 04 22:22:47.974579 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.974551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.976314 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.976295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-metrics-certs\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:47.987764 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:47.987742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxhfw\" (UniqueName: \"kubernetes.io/projected/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-kube-api-access-pxhfw\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:48.479273 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:48.478722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:48.482293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:48.482272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls\") pod \"maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:48.741621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:48.741522    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:49.030709 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:49.030532    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"]
Sep 04 22:22:49.032998 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:22:49.032970    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea5fae1_6dc3_4c1e_8bb5_b3ae131e9cd9.slice/crio-82d7efb9bd784aa3218600ca8530ee27287e319e8345cfa91a2d38052c786da9 WatchSource:0}: Error finding container 82d7efb9bd784aa3218600ca8530ee27287e319e8345cfa91a2d38052c786da9: Status 404 returned error can't find the container with id 82d7efb9bd784aa3218600ca8530ee27287e319e8345cfa91a2d38052c786da9
Sep 04 22:22:49.485026 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:49.484988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk" event={"ID":"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9","Type":"ContainerStarted","Data":"82d7efb9bd784aa3218600ca8530ee27287e319e8345cfa91a2d38052c786da9"}
Sep 04 22:22:50.492235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:50.492198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk" event={"ID":"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9","Type":"ContainerStarted","Data":"8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c"}
Sep 04 22:22:50.492578 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:50.492268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:50.513900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:50.513852    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk" podStartSLOduration=3.044456187 podStartE2EDuration="3.513832969s" totalImagesPullingTime="469.376782ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:22:50.5115906 +0000 UTC m=+844.315948125" watchObservedRunningTime="2026-09-04 22:22:50.513832969 +0000 UTC m=+844.318190497"
Sep 04 22:22:52.443161 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.443130    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"]
Sep 04 22:22:52.446225 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.446204    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.448367 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.448344    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c561f9fe-openshift-default-dockercfg-jhjt4\""
Sep 04 22:22:52.464593 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.464572    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"]
Sep 04 22:22:52.515411 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-socket\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515538 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-certs\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515538 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qrl\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-kube-api-access-r5qrl\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515641 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f84afa9-9882-42e9-b867-b2beb4725acf-istiod-ca-cert\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515641 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-podinfo\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515641 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-envoy\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515771 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-data\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515771 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-credential-socket\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.515846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.515777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-token\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.616645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.616590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-socket\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.616808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.616653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-certs\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.616808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.616683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qrl\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-kube-api-access-r5qrl\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.616808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.616710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f84afa9-9882-42e9-b867-b2beb4725acf-istiod-ca-cert\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.616808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.616737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-podinfo\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.616871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-envoy\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.616962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-data\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.617000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-credential-socket\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.617035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-certs\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.617058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-socket\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.617083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-token\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.617318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-credential-socket\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.617335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-data\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.617494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.617475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f84afa9-9882-42e9-b867-b2beb4725acf-istiod-ca-cert\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.619109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.619093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-envoy\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.619348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.619327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-podinfo\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.625569 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.625551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-token\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.625915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.625893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qrl\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-kube-api-access-r5qrl\") pod \"e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") " pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:52.756163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:52.756078    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:53.050169 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.050141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"]
Sep 04 22:22:53.051815 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:22:53.051785    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f84afa9_9882_42e9_b867_b2beb4725acf.slice/crio-3a9c4fdf1dbb8d28d247a1ba0e21bec9d1c455c44ac2bab117ffd279ffb374ab WatchSource:0}: Error finding container 3a9c4fdf1dbb8d28d247a1ba0e21bec9d1c455c44ac2bab117ffd279ffb374ab: Status 404 returned error can't find the container with id 3a9c4fdf1dbb8d28d247a1ba0e21bec9d1c455c44ac2bab117ffd279ffb374ab
Sep 04 22:22:53.054241 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.054209    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:22:53.054315 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.054283    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:22:53.054358 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.054326    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:22:53.508970 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.508935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" event={"ID":"5f84afa9-9882-42e9-b867-b2beb4725acf","Type":"ContainerStarted","Data":"d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd"}
Sep 04 22:22:53.509378 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.508989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" event={"ID":"5f84afa9-9882-42e9-b867-b2beb4725acf","Type":"ContainerStarted","Data":"3a9c4fdf1dbb8d28d247a1ba0e21bec9d1c455c44ac2bab117ffd279ffb374ab"}
Sep 04 22:22:53.539433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.539372    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podStartSLOduration=1.539354816 podStartE2EDuration="1.539354816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:22:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:22:53.537989644 +0000 UTC m=+847.342347171" watchObservedRunningTime="2026-09-04 22:22:53.539354816 +0000 UTC m=+847.343712342"
Sep 04 22:22:53.756255 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:53.756215    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:54.766279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:54.766244    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:55.519681 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:55.519648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:55.520596 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:55.520579    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:22:56.220454 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.219754    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"]
Sep 04 22:22:56.223889 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.223867    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.226204 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.226177    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c561f9fe-serving-cert\""
Sep 04 22:22:56.253419 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.251963    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"]
Sep 04 22:22:56.367624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.361158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c543fbd-7a49-40fd-b406-d04774536926-openshift-service-ca\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.367624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.361247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-metrics-certs\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.367624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.361306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njb6m\" (UniqueName: \"kubernetes.io/projected/7c543fbd-7a49-40fd-b406-d04774536926-kube-api-access-njb6m\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.367624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.361391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.462545 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.462511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-metrics-certs\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.462761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.462581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njb6m\" (UniqueName: \"kubernetes.io/projected/7c543fbd-7a49-40fd-b406-d04774536926-kube-api-access-njb6m\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.462761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.462706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.462901 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:22:56.462836    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-serving-cert: secret "maas-api-e2e-ait-c561f9fe-serving-cert" not found
Sep 04 22:22:56.462901 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:22:56.462897    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls podName:7c543fbd-7a49-40fd-b406-d04774536926 nodeName:}" failed. No retries permitted until 2026-09-04 22:22:56.962877229 +0000 UTC m=+850.767234732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls") pod "maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs" (UID: "7c543fbd-7a49-40fd-b406-d04774536926") : secret "maas-api-e2e-ait-c561f9fe-serving-cert" not found
Sep 04 22:22:56.463203 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.463182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c543fbd-7a49-40fd-b406-d04774536926-openshift-service-ca\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.463884 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.463861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c543fbd-7a49-40fd-b406-d04774536926-openshift-service-ca\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.465522 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.465494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-metrics-certs\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.472920 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.472861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njb6m\" (UniqueName: \"kubernetes.io/projected/7c543fbd-7a49-40fd-b406-d04774536926-kube-api-access-njb6m\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.502560 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.502541    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:22:56.968495 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.968459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:56.971645 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:56.971023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls\") pod \"maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:57.144625 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:57.142796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:22:57.469535 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:57.469173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"]
Sep 04 22:22:57.471552 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:22:57.471507    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c543fbd_7a49_40fd_b406_d04774536926.slice/crio-46e81dcc6bd32ede9f81c4ba74e737b67d13d9e0a3092cc3dbaa3afccd91b53b WatchSource:0}: Error finding container 46e81dcc6bd32ede9f81c4ba74e737b67d13d9e0a3092cc3dbaa3afccd91b53b: Status 404 returned error can't find the container with id 46e81dcc6bd32ede9f81c4ba74e737b67d13d9e0a3092cc3dbaa3afccd91b53b
Sep 04 22:22:57.530343 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:57.530276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs" event={"ID":"7c543fbd-7a49-40fd-b406-d04774536926","Type":"ContainerStarted","Data":"46e81dcc6bd32ede9f81c4ba74e737b67d13d9e0a3092cc3dbaa3afccd91b53b"}
Sep 04 22:22:58.538474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:58.538427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs" event={"ID":"7c543fbd-7a49-40fd-b406-d04774536926","Type":"ContainerStarted","Data":"4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92"}
Sep 04 22:22:58.539393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:22:58.539367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:23:02.505775 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:02.505729    2564 patch_prober.go:28] interesting pod/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:23:02.506181 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:02.505800    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:23:03.573916 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:03.573884    2564 generic.go:356] "Generic (PLEG): container finished" podID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerID="3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b" exitCode=0
Sep 04 22:23:03.574317 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:03.573967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" event={"ID":"58b7af99-a653-4b1f-8165-6a1b6448b972","Type":"ContainerDied","Data":"3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b"}
Sep 04 22:23:03.574379 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:03.574363    2564 scope.go:117] "RemoveContainer" containerID="3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b"
Sep 04 22:23:03.575433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:03.575402    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:23:03.575496 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:03.575485    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:23:03.575542 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:03.575521    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:23:03.595430 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:03.595377    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs" podStartSLOduration=7.262562863 podStartE2EDuration="7.595358946s" totalImagesPullingTime="332.796083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:22:58.560369332 +0000 UTC m=+852.364726857" watchObservedRunningTime="2026-09-04 22:23:03.595358946 +0000 UTC m=+857.399716471"
Sep 04 22:23:04.587066 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:04.586971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" event={"ID":"58b7af99-a653-4b1f-8165-6a1b6448b972","Type":"ContainerStarted","Data":"12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90"}
Sep 04 22:23:04.882627 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:04.882518    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:23:04.882978 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:04.882953    2564 patch_prober.go:28] interesting pod/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 04 22:23:04.883159 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:04.883135    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 04 22:23:05.561824 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:05.561785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:23:05.883508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:05.883458    2564 patch_prober.go:28] interesting pod/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 04 22:23:05.884048 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:05.883532    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 04 22:23:06.883179 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:06.883140    2564 patch_prober.go:28] interesting pod/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 04 22:23:06.883555 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:06.883517    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 04 22:23:07.882870 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:07.882833    2564 patch_prober.go:28] interesting pod/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 04 22:23:07.883021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:07.882899    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 04 22:23:08.882447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:08.882405    2564 patch_prober.go:28] interesting pod/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 04 22:23:08.882933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:08.882461    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 04 22:23:09.886907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:09.886870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:23:09.887359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:09.887341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:23:09.887982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:09.887963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:23:11.089774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.089629    2564 patch_prober.go:28] interesting pod/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:60990->10.134.0.50:15021: read: connection reset by peer" start-of-body=
Sep 04 22:23:11.089774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.089703    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:60990->10.134.0.50:15021: read: connection reset by peer"
Sep 04 22:23:11.629819 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.629785    2564 generic.go:356] "Generic (PLEG): container finished" podID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerID="d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd" exitCode=0
Sep 04 22:23:11.630018 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.629864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" event={"ID":"5f84afa9-9882-42e9-b867-b2beb4725acf","Type":"ContainerDied","Data":"d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd"}
Sep 04 22:23:11.630410 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.630387    2564 scope.go:117] "RemoveContainer" containerID="d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd"
Sep 04 22:23:11.631417 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.631391    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:23:11.631485 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.631456    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:23:11.631519 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:11.631489    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:23:12.639489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:12.639438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" event={"ID":"5f84afa9-9882-42e9-b867-b2beb4725acf","Type":"ContainerStarted","Data":"7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218"}
Sep 04 22:23:12.757016 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:12.756967    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:23:12.757355 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:12.757067    2564 patch_prober.go:28] interesting pod/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:23:12.757457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:12.757393    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 04 22:23:13.756949 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:13.756911    2564 patch_prober.go:28] interesting pod/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:23:13.757516 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:13.757481    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 04 22:23:14.757310 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:14.757265    2564 patch_prober.go:28] interesting pod/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:23:14.757782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:14.757341    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 04 22:23:15.756887 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:15.756850    2564 patch_prober.go:28] interesting pod/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:23:15.757165 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:15.757136    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 04 22:23:16.757369 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:16.757337    2564 patch_prober.go:28] interesting pod/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 04 22:23:16.757976 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:16.757923    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 04 22:23:17.760681 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:17.760647    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:23:17.761024 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:17.760922    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:23:17.761710 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:17.761692    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:23:37.051484 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.051448    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"]
Sep 04 22:23:37.051995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.051701    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs" podUID="7c543fbd-7a49-40fd-b406-d04774536926" containerName="maas-api" containerID="cri-o://4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92" gracePeriod=30
Sep 04 22:23:37.303208 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.303151    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:23:37.403457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.403427    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-metrics-certs\") pod \"7c543fbd-7a49-40fd-b406-d04774536926\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") "
Sep 04 22:23:37.403664 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.403520    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c543fbd-7a49-40fd-b406-d04774536926-openshift-service-ca\") pod \"7c543fbd-7a49-40fd-b406-d04774536926\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") "
Sep 04 22:23:37.403664 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.403544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls\") pod \"7c543fbd-7a49-40fd-b406-d04774536926\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") "
Sep 04 22:23:37.403664 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.403565    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njb6m\" (UniqueName: \"kubernetes.io/projected/7c543fbd-7a49-40fd-b406-d04774536926-kube-api-access-njb6m\") pod \"7c543fbd-7a49-40fd-b406-d04774536926\" (UID: \"7c543fbd-7a49-40fd-b406-d04774536926\") "
Sep 04 22:23:37.403982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.403946    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c543fbd-7a49-40fd-b406-d04774536926-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c543fbd-7a49-40fd-b406-d04774536926" (UID: "7c543fbd-7a49-40fd-b406-d04774536926"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:23:37.406248 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.406220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c543fbd-7a49-40fd-b406-d04774536926" (UID: "7c543fbd-7a49-40fd-b406-d04774536926"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:23:37.406400 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.406374    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7c543fbd-7a49-40fd-b406-d04774536926" (UID: "7c543fbd-7a49-40fd-b406-d04774536926"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:23:37.406400 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.406392    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c543fbd-7a49-40fd-b406-d04774536926-kube-api-access-njb6m" (OuterVolumeSpecName: "kube-api-access-njb6m") pod "7c543fbd-7a49-40fd-b406-d04774536926" (UID: "7c543fbd-7a49-40fd-b406-d04774536926"). InnerVolumeSpecName "kube-api-access-njb6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:23:37.453114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.453085    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"]
Sep 04 22:23:37.453347 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.453323    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy" containerID="cri-o://7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218" gracePeriod=30
Sep 04 22:23:37.505159 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.505134    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:37.505159 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.505157    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c543fbd-7a49-40fd-b406-d04774536926-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:37.505294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.505166    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c543fbd-7a49-40fd-b406-d04774536926-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:37.505294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.505174    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njb6m\" (UniqueName: \"kubernetes.io/projected/7c543fbd-7a49-40fd-b406-d04774536926-kube-api-access-njb6m\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:37.798100 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.798064    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c543fbd-7a49-40fd-b406-d04774536926" containerID="4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92" exitCode=0
Sep 04 22:23:37.798267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.798110    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"
Sep 04 22:23:37.798267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.798146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs" event={"ID":"7c543fbd-7a49-40fd-b406-d04774536926","Type":"ContainerDied","Data":"4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92"}
Sep 04 22:23:37.798267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.798208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs" event={"ID":"7c543fbd-7a49-40fd-b406-d04774536926","Type":"ContainerDied","Data":"46e81dcc6bd32ede9f81c4ba74e737b67d13d9e0a3092cc3dbaa3afccd91b53b"}
Sep 04 22:23:37.798267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.798222    2564 scope.go:117] "RemoveContainer" containerID="4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92"
Sep 04 22:23:37.807446 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.807416    2564 scope.go:117] "RemoveContainer" containerID="4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92"
Sep 04 22:23:37.807729 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:23:37.807710    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92\": container with ID starting with 4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92 not found: ID does not exist" containerID="4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92"
Sep 04 22:23:37.807791 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.807736    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92"} err="failed to get container status \"4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92\": rpc error: code = NotFound desc = could not find container \"4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92\": container with ID starting with 4021a0078a730a7e2834892127a05070fa7e9487d08a78180663262b99ae5b92 not found: ID does not exist"
Sep 04 22:23:37.820420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.820399    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"]
Sep 04 22:23:37.827189 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:37.827170    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c561f9fe-7b7754db-pp6zs"]
Sep 04 22:23:38.672409 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:38.672376    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c543fbd-7a49-40fd-b406-d04774536926" path="/var/lib/kubelet/pods/7c543fbd-7a49-40fd-b406-d04774536926/volumes"
Sep 04 22:23:40.824470 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.824437    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"]
Sep 04 22:23:40.824905 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.824891    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c543fbd-7a49-40fd-b406-d04774536926" containerName="maas-api"
Sep 04 22:23:40.824950 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.824907    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c543fbd-7a49-40fd-b406-d04774536926" containerName="maas-api"
Sep 04 22:23:40.825007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.824995    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c543fbd-7a49-40fd-b406-d04774536926" containerName="maas-api"
Sep 04 22:23:40.829514 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.829494    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:40.832001 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.831979    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-bb137412-serving-cert\""
Sep 04 22:23:40.839779 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.839749    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"]
Sep 04 22:23:40.942707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.942669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2r7\" (UniqueName: \"kubernetes.io/projected/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-kube-api-access-tt2r7\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:40.942970 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.942941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-metrics-certs\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:40.943180 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.943163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:40.943336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:40.943320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.043952 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.043917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2r7\" (UniqueName: \"kubernetes.io/projected/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-kube-api-access-tt2r7\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.044142 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.043990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-metrics-certs\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.044142 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.044055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.044142 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.044119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.044305 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:23:41.044193    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-serving-cert: secret "maas-api-e2e-migrate-bb137412-serving-cert" not found
Sep 04 22:23:41.044305 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:23:41.044257    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls podName:a3dbafa7-47e3-4987-bccb-e6ad7b52c456 nodeName:}" failed. No retries permitted until 2026-09-04 22:23:41.544239276 +0000 UTC m=+895.348596778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls") pod "maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs" (UID: "a3dbafa7-47e3-4987-bccb-e6ad7b52c456") : secret "maas-api-e2e-migrate-bb137412-serving-cert" not found
Sep 04 22:23:41.044976 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.044953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.046661 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.046631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-metrics-certs\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.056643 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.056617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2r7\" (UniqueName: \"kubernetes.io/projected/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-kube-api-access-tt2r7\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.550195 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.550161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.552478 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.552457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls\") pod \"maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:41.745358 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:41.745325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:42.021654 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.021623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"]
Sep 04 22:23:42.023661 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:23:42.023634    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3dbafa7_47e3_4987_bccb_e6ad7b52c456.slice/crio-517a27210107e60c15bbb23f8fe665ebd36828a826edd2043928a51182990c7e WatchSource:0}: Error finding container 517a27210107e60c15bbb23f8fe665ebd36828a826edd2043928a51182990c7e: Status 404 returned error can't find the container with id 517a27210107e60c15bbb23f8fe665ebd36828a826edd2043928a51182990c7e
Sep 04 22:23:42.737621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.737562    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:23:42.770731 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.770702    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-podinfo\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.770915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.770741    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-certs\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.770915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.770774    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f84afa9-9882-42e9-b867-b2beb4725acf-istiod-ca-cert\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.770915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.770792    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-data\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.770915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.770843    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-envoy\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.770915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.770874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-credential-socket\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.770915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.770915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-socket\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.771221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771010    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5qrl\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-kube-api-access-r5qrl\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.771221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771025    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-token\") pod \"5f84afa9-9882-42e9-b867-b2beb4725acf\" (UID: \"5f84afa9-9882-42e9-b867-b2beb4725acf\") "
Sep 04 22:23:42.771221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:23:42.771221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771118    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:23:42.771221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771215    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:23:42.771453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771125    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f84afa9-9882-42e9-b867-b2beb4725acf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:23:42.771453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771407    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f84afa9-9882-42e9-b867-b2beb4725acf-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.771453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771415    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:23:42.771453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771427    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.771653 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771461    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.771653 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.771477    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.773035 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.773006    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:23:42.773418 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.773394    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-kube-api-access-r5qrl" (OuterVolumeSpecName: "kube-api-access-r5qrl") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "kube-api-access-r5qrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:23:42.773509 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.773437    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:23:42.773932 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.773908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f84afa9-9882-42e9-b867-b2beb4725acf" (UID: "5f84afa9-9882-42e9-b867-b2beb4725acf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:23:42.841539 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.841504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs" event={"ID":"a3dbafa7-47e3-4987-bccb-e6ad7b52c456","Type":"ContainerStarted","Data":"37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4"}
Sep 04 22:23:42.841742 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.841560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs" event={"ID":"a3dbafa7-47e3-4987-bccb-e6ad7b52c456","Type":"ContainerStarted","Data":"517a27210107e60c15bbb23f8fe665ebd36828a826edd2043928a51182990c7e"}
Sep 04 22:23:42.841742 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.841636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:42.843390 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.843365    2564 generic.go:356] "Generic (PLEG): container finished" podID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerID="7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218" exitCode=0
Sep 04 22:23:42.843503 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.843404    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"
Sep 04 22:23:42.843503 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.843445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" event={"ID":"5f84afa9-9882-42e9-b867-b2beb4725acf","Type":"ContainerDied","Data":"7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218"}
Sep 04 22:23:42.843503 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.843490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh" event={"ID":"5f84afa9-9882-42e9-b867-b2beb4725acf","Type":"ContainerDied","Data":"3a9c4fdf1dbb8d28d247a1ba0e21bec9d1c455c44ac2bab117ffd279ffb374ab"}
Sep 04 22:23:42.843643 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.843513    2564 scope.go:117] "RemoveContainer" containerID="7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218"
Sep 04 22:23:42.853670 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.853652    2564 scope.go:117] "RemoveContainer" containerID="d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd"
Sep 04 22:23:42.860857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.860813    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs" podStartSLOduration=2.488374644 podStartE2EDuration="2.860798212s" totalImagesPullingTime="372.423568ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:23:42.858250923 +0000 UTC m=+896.662608461" watchObservedRunningTime="2026-09-04 22:23:42.860798212 +0000 UTC m=+896.665155736"
Sep 04 22:23:42.862749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.862730    2564 scope.go:117] "RemoveContainer" containerID="7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218"
Sep 04 22:23:42.863037 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:23:42.863018    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218\": container with ID starting with 7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218 not found: ID does not exist" containerID="7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218"
Sep 04 22:23:42.863105 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.863050    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218"} err="failed to get container status \"7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218\": rpc error: code = NotFound desc = could not find container \"7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218\": container with ID starting with 7ff17ff0ff8c96bf21944b5759b8f03203cb39ac266929bcbe449f3363de7218 not found: ID does not exist"
Sep 04 22:23:42.863105 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.863074    2564 scope.go:117] "RemoveContainer" containerID="d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd"
Sep 04 22:23:42.866093 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:23:42.864240    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd\": container with ID starting with d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd not found: ID does not exist" containerID="d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd"
Sep 04 22:23:42.866093 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.864273    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd"} err="failed to get container status \"d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd\": rpc error: code = NotFound desc = could not find container \"d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd\": container with ID starting with d8263c5164906d8d664c21a68613368eeebe4889f3fca87238952325175a78fd not found: ID does not exist"
Sep 04 22:23:42.872152 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.872128    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5qrl\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-kube-api-access-r5qrl\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.872258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.872155    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.872258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.872168    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.872258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.872177    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.872258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.872185    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f84afa9-9882-42e9-b867-b2beb4725acf-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:23:42.876187 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.876164    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"]
Sep 04 22:23:42.880082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:42.880064    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c561f9fe-openshift-default-7d4d856486-97vqh"]
Sep 04 22:23:44.671486 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:44.671451    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" path="/var/lib/kubelet/pods/5f84afa9-9882-42e9-b867-b2beb4725acf/volumes"
Sep 04 22:23:48.855768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:48.855730    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:23:57.779723 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.779674    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"]
Sep 04 22:23:57.780346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.780324    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy"
Sep 04 22:23:57.780443 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.780349    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy"
Sep 04 22:23:57.780516 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.780502    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy"
Sep 04 22:23:57.780570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.780519    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy"
Sep 04 22:23:57.783815 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.783792    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:57.786265 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.786238    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-8b0d12be-kserve-self-signed-certs\""
Sep 04 22:23:57.791743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.791723    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"]
Sep 04 22:23:57.923651 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.923609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tmp-dir\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:57.923651 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.923652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6kxt\" (UniqueName: \"kubernetes.io/projected/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-kube-api-access-r6kxt\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:57.923907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.923724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-dshm\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:57.923907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.923757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-model-cache\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:57.923907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.923796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tls-certs\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:57.923907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:57.923819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-home\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024456 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tmp-dir\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024456 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6kxt\" (UniqueName: \"kubernetes.io/projected/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-kube-api-access-r6kxt\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-dshm\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-model-cache\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tls-certs\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-home\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024993 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-model-cache\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.024993 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.024970    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tmp-dir\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.025081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.025010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-home\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.026742 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.026717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-dshm\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.027073 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.027051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tls-certs\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.036948 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.036881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6kxt\" (UniqueName: \"kubernetes.io/projected/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-kube-api-access-r6kxt\") pod \"e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") " pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.093588 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.093554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:23:58.369287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.369260    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"]
Sep 04 22:23:58.371050 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:23:58.371026    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fc7f9f1_1bc2_4f3e_ba4e_1614fc0721b7.slice/crio-9d47695f000f70036b069dcc1284dcf33bb3c2df2f3551ec4fefab998f22a1d1 WatchSource:0}: Error finding container 9d47695f000f70036b069dcc1284dcf33bb3c2df2f3551ec4fefab998f22a1d1: Status 404 returned error can't find the container with id 9d47695f000f70036b069dcc1284dcf33bb3c2df2f3551ec4fefab998f22a1d1
Sep 04 22:23:58.932403 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.932359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm" event={"ID":"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7","Type":"ContainerStarted","Data":"b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c"}
Sep 04 22:23:58.932816 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.932411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm" event={"ID":"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7","Type":"ContainerStarted","Data":"9d47695f000f70036b069dcc1284dcf33bb3c2df2f3551ec4fefab998f22a1d1"}
Sep 04 22:23:58.951959 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:23:58.951906    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm" podStartSLOduration=1.951888386 podStartE2EDuration="1.951888386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:23:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:23:58.94995892 +0000 UTC m=+912.754316443" watchObservedRunningTime="2026-09-04 22:23:58.951888386 +0000 UTC m=+912.756245945"
Sep 04 22:24:08.094776 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:08.094735    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:24:08.095176 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:08.094797    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:24:08.106941 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:08.106915    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:24:09.002173 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:09.002142    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:24:12.294284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.294243    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"]
Sep 04 22:24:12.294786 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.294491    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs" podUID="a3dbafa7-47e3-4987-bccb-e6ad7b52c456" containerName="maas-api" containerID="cri-o://37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4" gracePeriod=30
Sep 04 22:24:12.565531 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.565507    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:24:12.672965 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.672928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-metrics-certs\") pod \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") "
Sep 04 22:24:12.673129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.672984    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls\") pod \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") "
Sep 04 22:24:12.673129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.673020    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-openshift-service-ca\") pod \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") "
Sep 04 22:24:12.673251 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.673145    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt2r7\" (UniqueName: \"kubernetes.io/projected/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-kube-api-access-tt2r7\") pod \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\" (UID: \"a3dbafa7-47e3-4987-bccb-e6ad7b52c456\") "
Sep 04 22:24:12.673382 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.673353    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3dbafa7-47e3-4987-bccb-e6ad7b52c456" (UID: "a3dbafa7-47e3-4987-bccb-e6ad7b52c456"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:24:12.673497 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.673458    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:12.675155 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.675135    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a3dbafa7-47e3-4987-bccb-e6ad7b52c456" (UID: "a3dbafa7-47e3-4987-bccb-e6ad7b52c456"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:24:12.675239 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.675194    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-kube-api-access-tt2r7" (OuterVolumeSpecName: "kube-api-access-tt2r7") pod "a3dbafa7-47e3-4987-bccb-e6ad7b52c456" (UID: "a3dbafa7-47e3-4987-bccb-e6ad7b52c456"). InnerVolumeSpecName "kube-api-access-tt2r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:24:12.675239 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.675229    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3dbafa7-47e3-4987-bccb-e6ad7b52c456" (UID: "a3dbafa7-47e3-4987-bccb-e6ad7b52c456"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:24:12.774475 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.774441    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt2r7\" (UniqueName: \"kubernetes.io/projected/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-kube-api-access-tt2r7\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:12.774475 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.774475    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:12.774475 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:12.774485    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3dbafa7-47e3-4987-bccb-e6ad7b52c456-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:13.013374 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.013281    2564 generic.go:356] "Generic (PLEG): container finished" podID="a3dbafa7-47e3-4987-bccb-e6ad7b52c456" containerID="37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4" exitCode=0
Sep 04 22:24:13.013374 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.013338    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"
Sep 04 22:24:13.013374 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.013364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs" event={"ID":"a3dbafa7-47e3-4987-bccb-e6ad7b52c456","Type":"ContainerDied","Data":"37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4"}
Sep 04 22:24:13.013686 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.013418    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs" event={"ID":"a3dbafa7-47e3-4987-bccb-e6ad7b52c456","Type":"ContainerDied","Data":"517a27210107e60c15bbb23f8fe665ebd36828a826edd2043928a51182990c7e"}
Sep 04 22:24:13.013686 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.013441    2564 scope.go:117] "RemoveContainer" containerID="37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4"
Sep 04 22:24:13.023312 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.023283    2564 scope.go:117] "RemoveContainer" containerID="37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4"
Sep 04 22:24:13.023640 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:13.023594    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4\": container with ID starting with 37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4 not found: ID does not exist" containerID="37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4"
Sep 04 22:24:13.023734 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.023649    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4"} err="failed to get container status \"37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4\": rpc error: code = NotFound desc = could not find container \"37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4\": container with ID starting with 37980c597c02f73e4f709a700a850668635e4236577046d9429caab51d96a9a4 not found: ID does not exist"
Sep 04 22:24:13.036984 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.036947    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"]
Sep 04 22:24:13.040964 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.040939    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb137412-7d7fb68db-dlhcs"]
Sep 04 22:24:13.508566 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.508533    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"]
Sep 04 22:24:13.509074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.508978    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3dbafa7-47e3-4987-bccb-e6ad7b52c456" containerName="maas-api"
Sep 04 22:24:13.509074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.508992    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3dbafa7-47e3-4987-bccb-e6ad7b52c456" containerName="maas-api"
Sep 04 22:24:13.509074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.509017    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy"
Sep 04 22:24:13.509074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.509023    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f84afa9-9882-42e9-b867-b2beb4725acf" containerName="istio-proxy"
Sep 04 22:24:13.509279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.509089    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3dbafa7-47e3-4987-bccb-e6ad7b52c456" containerName="maas-api"
Sep 04 22:24:13.512089 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.512068    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.514421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.514399    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-20c0448a-openshift-default-dockercfg-4t5kf\""
Sep 04 22:24:13.525857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.525836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"]
Sep 04 22:24:13.682824 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.682786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-token\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.682978 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.682847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38029fb5-3dd9-4cf1-8079-40cba4483a14-istiod-ca-cert\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.682978 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.682936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-credential-socket\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.683071 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.683002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfz9z\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-kube-api-access-kfz9z\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.683071 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.683056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-podinfo\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.683166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.683084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-envoy\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.683166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.683156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-socket\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.683277 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.683189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-certs\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.683277 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.683217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-data\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.784759 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.784581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-podinfo\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.784759 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.784666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-envoy\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.784759 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.784718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-socket\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785122 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-socket\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-certs\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-data\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-token\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38029fb5-3dd9-4cf1-8079-40cba4483a14-istiod-ca-cert\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-credential-socket\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785514 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfz9z\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-kube-api-access-kfz9z\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785514 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-certs\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.785966 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-credential-socket\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.786088 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.785991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-data\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.786344 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.786322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38029fb5-3dd9-4cf1-8079-40cba4483a14-istiod-ca-cert\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.787534 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.787508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-envoy\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.788161 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.788131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-podinfo\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.794592 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.794561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-token\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.794719 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.794647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfz9z\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-kube-api-access-kfz9z\") pod \"e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") " pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:13.823611 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:13.823558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:14.123874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:14.123841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"]
Sep 04 22:24:14.125214 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:24:14.125187    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38029fb5_3dd9_4cf1_8079_40cba4483a14.slice/crio-f0458e42951faa9d954191992d5d199cc4c1645fe9f5c9eba0852a3534fce72a WatchSource:0}: Error finding container f0458e42951faa9d954191992d5d199cc4c1645fe9f5c9eba0852a3534fce72a: Status 404 returned error can't find the container with id f0458e42951faa9d954191992d5d199cc4c1645fe9f5c9eba0852a3534fce72a
Sep 04 22:24:14.127632 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:14.127575    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:14.127736 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:14.127691    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:14.127778 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:14.127739    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:14.673116 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:14.673078    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3dbafa7-47e3-4987-bccb-e6ad7b52c456" path="/var/lib/kubelet/pods/a3dbafa7-47e3-4987-bccb-e6ad7b52c456/volumes"
Sep 04 22:24:15.030988 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:15.030894    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" event={"ID":"38029fb5-3dd9-4cf1-8079-40cba4483a14","Type":"ContainerStarted","Data":"c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece"}
Sep 04 22:24:15.030988 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:15.030949    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" event={"ID":"38029fb5-3dd9-4cf1-8079-40cba4483a14","Type":"ContainerStarted","Data":"f0458e42951faa9d954191992d5d199cc4c1645fe9f5c9eba0852a3534fce72a"}
Sep 04 22:24:15.052903 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:15.052823    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" podStartSLOduration=2.052805186 podStartE2EDuration="2.052805186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:24:15.052723256 +0000 UTC m=+928.857080780" watchObservedRunningTime="2026-09-04 22:24:15.052805186 +0000 UTC m=+928.857162710"
Sep 04 22:24:15.824718 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:15.824677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:15.829697 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:15.829669    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:16.036687 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:16.036653    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:16.046630 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:16.046573    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:17.519235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.519188    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"]
Sep 04 22:24:17.523217 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.523190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.526035 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.526007    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-20c0448a-serving-cert\""
Sep 04 22:24:17.535376 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.534856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"]
Sep 04 22:24:17.625961 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.625925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkn8t\" (UniqueName: \"kubernetes.io/projected/2335315f-2d09-4b26-9523-10393a1e7dec-kube-api-access-zkn8t\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.626144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.625983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-metrics-certs\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.626144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.626080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2335315f-2d09-4b26-9523-10393a1e7dec-openshift-service-ca\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.626144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.626136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.727294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.727256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkn8t\" (UniqueName: \"kubernetes.io/projected/2335315f-2d09-4b26-9523-10393a1e7dec-kube-api-access-zkn8t\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.727479 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.727314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-metrics-certs\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.727479 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.727357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2335315f-2d09-4b26-9523-10393a1e7dec-openshift-service-ca\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.727479 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.727392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.727671 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:17.727650    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-serving-cert: secret "maas-api-e2e-ait-20c0448a-serving-cert" not found
Sep 04 22:24:17.727765 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:17.727755    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls podName:2335315f-2d09-4b26-9523-10393a1e7dec nodeName:}" failed. No retries permitted until 2026-09-04 22:24:18.227734701 +0000 UTC m=+932.032092210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls") pod "maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" (UID: "2335315f-2d09-4b26-9523-10393a1e7dec") : secret "maas-api-e2e-ait-20c0448a-serving-cert" not found
Sep 04 22:24:17.728076 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.728045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2335315f-2d09-4b26-9523-10393a1e7dec-openshift-service-ca\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.730096 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.730068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-metrics-certs\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:17.738738 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:17.738707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkn8t\" (UniqueName: \"kubernetes.io/projected/2335315f-2d09-4b26-9523-10393a1e7dec-kube-api-access-zkn8t\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:18.232097 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:18.232064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:18.232265 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:18.232199    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-serving-cert: secret "maas-api-e2e-ait-20c0448a-serving-cert" not found
Sep 04 22:24:18.232310 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:18.232265    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls podName:2335315f-2d09-4b26-9523-10393a1e7dec nodeName:}" failed. No retries permitted until 2026-09-04 22:24:19.232249878 +0000 UTC m=+933.036607379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls") pod "maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" (UID: "2335315f-2d09-4b26-9523-10393a1e7dec") : secret "maas-api-e2e-ait-20c0448a-serving-cert" not found
Sep 04 22:24:19.240180 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:19.240138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:19.242585 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:19.242553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls\") pod \"maas-api-e2e-ait-20c0448a-744cf874c-pvgm4\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:19.337254 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:19.337217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:19.614866 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:19.614832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"]
Sep 04 22:24:19.616242 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:24:19.616209    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2335315f_2d09_4b26_9523_10393a1e7dec.slice/crio-97ff845f0d357ce5e237808db86d7bce63741b5ebdb293cfa9fa9e8e936dc126 WatchSource:0}: Error finding container 97ff845f0d357ce5e237808db86d7bce63741b5ebdb293cfa9fa9e8e936dc126: Status 404 returned error can't find the container with id 97ff845f0d357ce5e237808db86d7bce63741b5ebdb293cfa9fa9e8e936dc126
Sep 04 22:24:20.057928 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:20.057836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" event={"ID":"2335315f-2d09-4b26-9523-10393a1e7dec","Type":"ContainerStarted","Data":"97ff845f0d357ce5e237808db86d7bce63741b5ebdb293cfa9fa9e8e936dc126"}
Sep 04 22:24:21.065188 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:21.065138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" event={"ID":"2335315f-2d09-4b26-9523-10393a1e7dec","Type":"ContainerStarted","Data":"5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa"}
Sep 04 22:24:21.065613 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:21.065295    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:21.092043 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:21.091986    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" podStartSLOduration=3.505278363 podStartE2EDuration="4.091967307s" totalImagesPullingTime="586.688944ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:24:21.090535322 +0000 UTC m=+934.894892850" watchObservedRunningTime="2026-09-04 22:24:21.091967307 +0000 UTC m=+934.896324833"
Sep 04 22:24:27.076774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:27.076741    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:35.148570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:35.148529    2564 generic.go:356] "Generic (PLEG): container finished" podID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerID="c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece" exitCode=0
Sep 04 22:24:35.149127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:35.148620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" event={"ID":"38029fb5-3dd9-4cf1-8079-40cba4483a14","Type":"ContainerDied","Data":"c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece"}
Sep 04 22:24:35.149193 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:35.149162    2564 scope.go:117] "RemoveContainer" containerID="c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece"
Sep 04 22:24:35.150372 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:35.150337    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:35.150459 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:35.150407    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:35.150459 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:35.150439    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:36.160421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:36.160376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" event={"ID":"38029fb5-3dd9-4cf1-8079-40cba4483a14","Type":"ContainerStarted","Data":"b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5"}
Sep 04 22:24:36.823747 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:36.823714    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:36.823950 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:36.823929    2564 patch_prober.go:28] interesting pod/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:24:36.824002 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:36.823979    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 04 22:24:37.824021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:37.823981    2564 patch_prober.go:28] interesting pod/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:24:37.824402 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:37.824038    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 04 22:24:38.824819 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:38.824782    2564 patch_prober.go:28] interesting pod/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:24:38.825226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:38.824837    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 04 22:24:39.824257 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:39.824220    2564 patch_prober.go:28] interesting pod/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:24:39.824439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:39.824280    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 04 22:24:40.824830 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:40.824797    2564 patch_prober.go:28] interesting pod/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 04 22:24:40.825208 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:40.824856    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 04 22:24:41.828247 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:41.828218    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:41.828725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:41.828621    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:41.829362 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:41.829345    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:46.675530 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:46.675502    2564 scope.go:117] "RemoveContainer" containerID="ef27dc1c38face97652e46aff19ece53981694411df541090094642ade7f3f4a"
Sep 04 22:24:48.129220 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.129187    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"]
Sep 04 22:24:48.129668 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.129420    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" podUID="2335315f-2d09-4b26-9523-10393a1e7dec" containerName="maas-api" containerID="cri-o://5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa" gracePeriod=30
Sep 04 22:24:48.384336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.384281    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:48.536511 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.536470    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls\") pod \"2335315f-2d09-4b26-9523-10393a1e7dec\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") "
Sep 04 22:24:48.536728 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.536561    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2335315f-2d09-4b26-9523-10393a1e7dec-openshift-service-ca\") pod \"2335315f-2d09-4b26-9523-10393a1e7dec\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") "
Sep 04 22:24:48.536728 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.536628    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkn8t\" (UniqueName: \"kubernetes.io/projected/2335315f-2d09-4b26-9523-10393a1e7dec-kube-api-access-zkn8t\") pod \"2335315f-2d09-4b26-9523-10393a1e7dec\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") "
Sep 04 22:24:48.536867 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.536736    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-metrics-certs\") pod \"2335315f-2d09-4b26-9523-10393a1e7dec\" (UID: \"2335315f-2d09-4b26-9523-10393a1e7dec\") "
Sep 04 22:24:48.537630 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.537571    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2335315f-2d09-4b26-9523-10393a1e7dec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2335315f-2d09-4b26-9523-10393a1e7dec" (UID: "2335315f-2d09-4b26-9523-10393a1e7dec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:24:48.539197 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.539171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2335315f-2d09-4b26-9523-10393a1e7dec" (UID: "2335315f-2d09-4b26-9523-10393a1e7dec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:24:48.540420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.540379    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2335315f-2d09-4b26-9523-10393a1e7dec-kube-api-access-zkn8t" (OuterVolumeSpecName: "kube-api-access-zkn8t") pod "2335315f-2d09-4b26-9523-10393a1e7dec" (UID: "2335315f-2d09-4b26-9523-10393a1e7dec"). InnerVolumeSpecName "kube-api-access-zkn8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:24:48.540537 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.540495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2335315f-2d09-4b26-9523-10393a1e7dec" (UID: "2335315f-2d09-4b26-9523-10393a1e7dec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:24:48.638294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.638224    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:48.638294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.638252    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2335315f-2d09-4b26-9523-10393a1e7dec-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:48.638294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.638263    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkn8t\" (UniqueName: \"kubernetes.io/projected/2335315f-2d09-4b26-9523-10393a1e7dec-kube-api-access-zkn8t\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:48.638294 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:48.638272    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2335315f-2d09-4b26-9523-10393a1e7dec-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:49.233129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.233093    2564 generic.go:356] "Generic (PLEG): container finished" podID="2335315f-2d09-4b26-9523-10393a1e7dec" containerID="5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa" exitCode=0
Sep 04 22:24:49.233521 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.233141    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"
Sep 04 22:24:49.233521 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.233174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" event={"ID":"2335315f-2d09-4b26-9523-10393a1e7dec","Type":"ContainerDied","Data":"5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa"}
Sep 04 22:24:49.233521 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.233226    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4" event={"ID":"2335315f-2d09-4b26-9523-10393a1e7dec","Type":"ContainerDied","Data":"97ff845f0d357ce5e237808db86d7bce63741b5ebdb293cfa9fa9e8e936dc126"}
Sep 04 22:24:49.233521 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.233249    2564 scope.go:117] "RemoveContainer" containerID="5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa"
Sep 04 22:24:49.242703 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.242683    2564 scope.go:117] "RemoveContainer" containerID="5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa"
Sep 04 22:24:49.242995 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:49.242975    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa\": container with ID starting with 5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa not found: ID does not exist" containerID="5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa"
Sep 04 22:24:49.243087 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.243002    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa"} err="failed to get container status \"5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa\": rpc error: code = NotFound desc = could not find container \"5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa\": container with ID starting with 5172545ffa0386b65b581d20bf3808fd0fc8de9b3812a5ae06c90af7ce137faa not found: ID does not exist"
Sep 04 22:24:49.252014 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.251990    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"]
Sep 04 22:24:49.255903 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.255885    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20c0448a-744cf874c-pvgm4"]
Sep 04 22:24:49.465390 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.465351    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"]
Sep 04 22:24:49.465595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:49.465569    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy" containerID="cri-o://b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5" gracePeriod=30
Sep 04 22:24:50.188927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.188896    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"]
Sep 04 22:24:50.189458 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.189435    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2335315f-2d09-4b26-9523-10393a1e7dec" containerName="maas-api"
Sep 04 22:24:50.189458 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.189460    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2335315f-2d09-4b26-9523-10393a1e7dec" containerName="maas-api"
Sep 04 22:24:50.189639 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.189628    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2335315f-2d09-4b26-9523-10393a1e7dec" containerName="maas-api"
Sep 04 22:24:50.194507 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.194490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.197065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.197044    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-25fea002-openshift-default-dockercfg-lksdv\""
Sep 04 22:24:50.204272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.204253    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"]
Sep 04 22:24:50.354272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-certs\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-credential-socket\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-data\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-envoy\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbndd\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-kube-api-access-hbndd\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-socket\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-istio-token\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe8a891-96cc-4583-beee-1577d25922ea-istio-podinfo\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.354677 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.354587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe8a891-96cc-4583-beee-1577d25922ea-istiod-ca-cert\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-data\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-envoy\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455354 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbndd\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-kube-api-access-hbndd\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455706 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-socket\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455706 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-istio-token\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455706 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe8a891-96cc-4583-beee-1577d25922ea-istio-podinfo\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455706 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe8a891-96cc-4583-beee-1577d25922ea-istiod-ca-cert\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-certs\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-data\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-credential-socket\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.455925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-socket\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.456089 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.455999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-certs\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.456089 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.456059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-credential-socket\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.456324 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.456305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe8a891-96cc-4583-beee-1577d25922ea-istiod-ca-cert\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.457872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.457851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-envoy\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.457995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.457980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe8a891-96cc-4583-beee-1577d25922ea-istio-podinfo\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.464738 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.464718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-istio-token\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.465072 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.465055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbndd\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-kube-api-access-hbndd\") pod \"e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") " pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.506367 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.506340    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:50.671868 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.671835    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2335315f-2d09-4b26-9523-10393a1e7dec" path="/var/lib/kubelet/pods/2335315f-2d09-4b26-9523-10393a1e7dec/volumes"
Sep 04 22:24:50.787273 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.787249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"]
Sep 04 22:24:50.788937 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:24:50.788909    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe8a891_96cc_4583_beee_1577d25922ea.slice/crio-a64ead10c73b36e1179b514cb4ea2a45f4aadac99c9168a72d3e0127348c02c3 WatchSource:0}: Error finding container a64ead10c73b36e1179b514cb4ea2a45f4aadac99c9168a72d3e0127348c02c3: Status 404 returned error can't find the container with id a64ead10c73b36e1179b514cb4ea2a45f4aadac99c9168a72d3e0127348c02c3
Sep 04 22:24:50.791312 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.791278    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:50.791402 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.791346    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:50.791402 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:50.791371    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:24:51.248174 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:51.248135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" event={"ID":"dfe8a891-96cc-4583-beee-1577d25922ea","Type":"ContainerStarted","Data":"1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a"}
Sep 04 22:24:51.248351 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:51.248188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" event={"ID":"dfe8a891-96cc-4583-beee-1577d25922ea","Type":"ContainerStarted","Data":"a64ead10c73b36e1179b514cb4ea2a45f4aadac99c9168a72d3e0127348c02c3"}
Sep 04 22:24:51.270609 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:51.270551    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" podStartSLOduration=1.270535639 podStartE2EDuration="1.270535639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:24:51.269466156 +0000 UTC m=+965.073823680" watchObservedRunningTime="2026-09-04 22:24:51.270535639 +0000 UTC m=+965.074893163"
Sep 04 22:24:51.507213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:51.507143    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:51.512156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:51.512131    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:52.253261 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:52.253227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:52.254163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:52.254138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:24:54.723426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.723399    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:54.781032 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.780962    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"]
Sep 04 22:24:54.781378 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.781366    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy"
Sep 04 22:24:54.781420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.781379    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy"
Sep 04 22:24:54.781420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.781397    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy"
Sep 04 22:24:54.781420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.781402    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy"
Sep 04 22:24:54.781530 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.781458    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy"
Sep 04 22:24:54.784431 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.784416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:54.786654 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.786632    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-25fea002-dockercfg-rfc8x\""
Sep 04 22:24:54.786763 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.786642    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-25fea002\""
Sep 04 22:24:54.793716 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.793690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"]
Sep 04 22:24:54.897539 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfz9z\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-kube-api-access-kfz9z\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897555    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-socket\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-credential-socket\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897695    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-token\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38029fb5-3dd9-4cf1-8079-40cba4483a14-istiod-ca-cert\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897958 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897763    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-data\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897958 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897796    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-envoy\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897958 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897824    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-certs\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.897958 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.897916    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-podinfo\") pod \"38029fb5-3dd9-4cf1-8079-40cba4483a14\" (UID: \"38029fb5-3dd9-4cf1-8079-40cba4483a14\") "
Sep 04 22:24:54.898158 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.898103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ec1901-d6b7-44cb-b363-1173db0c3098-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:54.898220 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.898185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g9rv\" (UniqueName: \"kubernetes.io/projected/33ec1901-d6b7-44cb-b363-1173db0c3098-kube-api-access-9g9rv\") pod \"payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:54.899453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.899405    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:24:54.899577 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.899561    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-data" (OuterVolumeSpecName: "istio-data") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:24:54.899710 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.899679    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38029fb5-3dd9-4cf1-8079-40cba4483a14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:24:54.900023 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.899999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:24:54.900213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.900192    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:24:54.904591 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.903920    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:24:54.904591 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.903942    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-token" (OuterVolumeSpecName: "istio-token") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:24:54.904591 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.904296    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:24:54.904874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.904698    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-kube-api-access-kfz9z" (OuterVolumeSpecName: "kube-api-access-kfz9z") pod "38029fb5-3dd9-4cf1-8079-40cba4483a14" (UID: "38029fb5-3dd9-4cf1-8079-40cba4483a14"). InnerVolumeSpecName "kube-api-access-kfz9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:24:54.999848 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.999796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g9rv\" (UniqueName: \"kubernetes.io/projected/33ec1901-d6b7-44cb-b363-1173db0c3098-kube-api-access-9g9rv\") pod \"payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:55.000018 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:54.999968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ec1901-d6b7-44cb-b363-1173db0c3098-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:55.000070 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000032    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfz9z\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-kube-api-access-kfz9z\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000070 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000048    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000070 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000064    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000182 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000076    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000182 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000089    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38029fb5-3dd9-4cf1-8079-40cba4483a14-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000182 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000100    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000182 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000111    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000182 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000122    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38029fb5-3dd9-4cf1-8079-40cba4483a14-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000182 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000132    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38029fb5-3dd9-4cf1-8079-40cba4483a14-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:24:55.000664 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.000644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ec1901-d6b7-44cb-b363-1173db0c3098-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:55.008609 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.008573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g9rv\" (UniqueName: \"kubernetes.io/projected/33ec1901-d6b7-44cb-b363-1173db0c3098-kube-api-access-9g9rv\") pod \"payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:55.096615 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.096574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:55.273607 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.273556    2564 generic.go:356] "Generic (PLEG): container finished" podID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerID="b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5" exitCode=0
Sep 04 22:24:55.273767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.273611    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"
Sep 04 22:24:55.273767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.273634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" event={"ID":"38029fb5-3dd9-4cf1-8079-40cba4483a14","Type":"ContainerDied","Data":"b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5"}
Sep 04 22:24:55.273767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.273698    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5" event={"ID":"38029fb5-3dd9-4cf1-8079-40cba4483a14","Type":"ContainerDied","Data":"f0458e42951faa9d954191992d5d199cc4c1645fe9f5c9eba0852a3534fce72a"}
Sep 04 22:24:55.273767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.273728    2564 scope.go:117] "RemoveContainer" containerID="b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5"
Sep 04 22:24:55.284279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.284260    2564 scope.go:117] "RemoveContainer" containerID="c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece"
Sep 04 22:24:55.292607 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.292574    2564 scope.go:117] "RemoveContainer" containerID="b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5"
Sep 04 22:24:55.292936 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:55.292917    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5\": container with ID starting with b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5 not found: ID does not exist" containerID="b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5"
Sep 04 22:24:55.293012 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.292949    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5"} err="failed to get container status \"b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5\": rpc error: code = NotFound desc = could not find container \"b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5\": container with ID starting with b2c5859b58b566f848bd6574bc88f377bd7c1d08989e73f91c9cf6995e87ebb5 not found: ID does not exist"
Sep 04 22:24:55.293012 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.292976    2564 scope.go:117] "RemoveContainer" containerID="c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece"
Sep 04 22:24:55.293227 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:24:55.293210    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece\": container with ID starting with c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece not found: ID does not exist" containerID="c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece"
Sep 04 22:24:55.293268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.293236    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece"} err="failed to get container status \"c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece\": rpc error: code = NotFound desc = could not find container \"c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece\": container with ID starting with c365baaab76d83943fc21e0dc7b50a66768b102ba6efb9d08d6715af678aeece not found: ID does not exist"
Sep 04 22:24:55.299385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.299357    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"]
Sep 04 22:24:55.306548 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.306523    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-20c0448a-openshift-default-57fd9c9cd8-x6fq5"]
Sep 04 22:24:55.374444 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:55.374407    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"]
Sep 04 22:24:55.375651 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:24:55.375623    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ec1901_d6b7_44cb_b363_1173db0c3098.slice/crio-f94f17ac2bbb38fc4f56cb45a1e809689309e6a23509f7f0c03c2a119dcaecf6 WatchSource:0}: Error finding container f94f17ac2bbb38fc4f56cb45a1e809689309e6a23509f7f0c03c2a119dcaecf6: Status 404 returned error can't find the container with id f94f17ac2bbb38fc4f56cb45a1e809689309e6a23509f7f0c03c2a119dcaecf6
Sep 04 22:24:56.280112 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:56.280067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds" event={"ID":"33ec1901-d6b7-44cb-b363-1173db0c3098","Type":"ContainerStarted","Data":"05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb"}
Sep 04 22:24:56.280569 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:56.280178    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:24:56.280569 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:56.280209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds" event={"ID":"33ec1901-d6b7-44cb-b363-1173db0c3098","Type":"ContainerStarted","Data":"f94f17ac2bbb38fc4f56cb45a1e809689309e6a23509f7f0c03c2a119dcaecf6"}
Sep 04 22:24:56.297590 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:56.297539    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds" podStartSLOduration=2.297525118 podStartE2EDuration="2.297525118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:24:56.296317446 +0000 UTC m=+970.100674971" watchObservedRunningTime="2026-09-04 22:24:56.297525118 +0000 UTC m=+970.101882640"
Sep 04 22:24:56.672189 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:24:56.672157    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" path="/var/lib/kubelet/pods/38029fb5-3dd9-4cf1-8079-40cba4483a14/volumes"
Sep 04 22:25:07.291123 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:07.291094    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:25:13.391372 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:13.391294    2564 generic.go:356] "Generic (PLEG): container finished" podID="dfe8a891-96cc-4583-beee-1577d25922ea" containerID="1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a" exitCode=0
Sep 04 22:25:13.391372 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:13.391349    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" event={"ID":"dfe8a891-96cc-4583-beee-1577d25922ea","Type":"ContainerDied","Data":"1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a"}
Sep 04 22:25:13.391882 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:13.391742    2564 scope.go:117] "RemoveContainer" containerID="1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a"
Sep 04 22:25:13.392850 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:13.392819    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:25:13.392921 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:13.392905    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:25:13.392964 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:13.392951    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:25:14.398315 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:14.398282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" event={"ID":"dfe8a891-96cc-4583-beee-1577d25922ea","Type":"ContainerStarted","Data":"b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa"}
Sep 04 22:25:14.506674 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:14.506633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:25:14.506885 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:14.506864    2564 patch_prober.go:28] interesting pod/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:25:14.506944 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:14.506919    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 04 22:25:15.507021 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:15.506988    2564 patch_prober.go:28] interesting pod/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:25:15.507398 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:15.507048    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 04 22:25:16.506886 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:16.506854    2564 patch_prober.go:28] interesting pod/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:25:16.507059 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:16.506930    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 04 22:25:17.507425 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:17.507386    2564 patch_prober.go:28] interesting pod/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:25:17.507842 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:17.507444    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 04 22:25:18.507732 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:18.507692    2564 patch_prober.go:28] interesting pod/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 04 22:25:18.508217 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:18.507764    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 04 22:25:19.732154 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:19.732121    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:25:19.732850 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:19.732819    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:25:19.734163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:19.734134    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:25:24.391825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.391782    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"]
Sep 04 22:25:24.392279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.392044    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds" podUID="33ec1901-d6b7-44cb-b363-1173db0c3098" containerName="payload-pre-processing" containerID="cri-o://05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb" gracePeriod=30
Sep 04 22:25:24.657614 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.657518    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:25:24.703173 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.703139    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"]
Sep 04 22:25:24.703408 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.703365    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy" containerID="cri-o://b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa" gracePeriod=30
Sep 04 22:25:24.783840 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.783810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g9rv\" (UniqueName: \"kubernetes.io/projected/33ec1901-d6b7-44cb-b363-1173db0c3098-kube-api-access-9g9rv\") pod \"33ec1901-d6b7-44cb-b363-1173db0c3098\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") "
Sep 04 22:25:24.783996 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.783876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ec1901-d6b7-44cb-b363-1173db0c3098-plugins-config-volume\") pod \"33ec1901-d6b7-44cb-b363-1173db0c3098\" (UID: \"33ec1901-d6b7-44cb-b363-1173db0c3098\") "
Sep 04 22:25:24.784302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.784277    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ec1901-d6b7-44cb-b363-1173db0c3098-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33ec1901-d6b7-44cb-b363-1173db0c3098" (UID: "33ec1901-d6b7-44cb-b363-1173db0c3098"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:25:24.785905 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.785879    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33ec1901-d6b7-44cb-b363-1173db0c3098-kube-api-access-9g9rv" (OuterVolumeSpecName: "kube-api-access-9g9rv") pod "33ec1901-d6b7-44cb-b363-1173db0c3098" (UID: "33ec1901-d6b7-44cb-b363-1173db0c3098"). InnerVolumeSpecName "kube-api-access-9g9rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:25:24.885753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.885718    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g9rv\" (UniqueName: \"kubernetes.io/projected/33ec1901-d6b7-44cb-b363-1173db0c3098-kube-api-access-9g9rv\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:24.885753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:24.885752    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33ec1901-d6b7-44cb-b363-1173db0c3098-plugins-config-volume\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:25.458540 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.458505    2564 generic.go:356] "Generic (PLEG): container finished" podID="33ec1901-d6b7-44cb-b363-1173db0c3098" containerID="05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb" exitCode=0
Sep 04 22:25:25.459003 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.458550    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"
Sep 04 22:25:25.459003 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.458553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds" event={"ID":"33ec1901-d6b7-44cb-b363-1173db0c3098","Type":"ContainerDied","Data":"05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb"}
Sep 04 22:25:25.459003 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.458699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds" event={"ID":"33ec1901-d6b7-44cb-b363-1173db0c3098","Type":"ContainerDied","Data":"f94f17ac2bbb38fc4f56cb45a1e809689309e6a23509f7f0c03c2a119dcaecf6"}
Sep 04 22:25:25.459003 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.458738    2564 scope.go:117] "RemoveContainer" containerID="05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb"
Sep 04 22:25:25.467935 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.467919    2564 scope.go:117] "RemoveContainer" containerID="05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb"
Sep 04 22:25:25.468208 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:25:25.468186    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb\": container with ID starting with 05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb not found: ID does not exist" containerID="05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb"
Sep 04 22:25:25.468256 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.468216    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb"} err="failed to get container status \"05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb\": rpc error: code = NotFound desc = could not find container \"05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb\": container with ID starting with 05fae3bb7354d92efcc0dc29123344a1cdb6a340029ddc2e0c4d63b78eb4b2bb not found: ID does not exist"
Sep 04 22:25:25.481754 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.481730    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"]
Sep 04 22:25:25.485958 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:25.485939    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-25fea002-7cc6d4c474-cqbds"]
Sep 04 22:25:26.671274 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:26.671233    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33ec1901-d6b7-44cb-b363-1173db0c3098" path="/var/lib/kubelet/pods/33ec1901-d6b7-44cb-b363-1173db0c3098/volumes"
Sep 04 22:25:29.970202 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:29.970151    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:25:30.031808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.031781    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-credential-socket\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.031940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.031819    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-envoy\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.031940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.031838    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbndd\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-kube-api-access-hbndd\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.031940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.031880    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe8a891-96cc-4583-beee-1577d25922ea-istiod-ca-cert\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.031940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.031907    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-socket\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.032160 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.031959    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-certs\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.032160 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032026    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe8a891-96cc-4583-beee-1577d25922ea-istio-podinfo\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.032160 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032046    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-data\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.032160 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:25:30.032160 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032073    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-istio-token\") pod \"dfe8a891-96cc-4583-beee-1577d25922ea\" (UID: \"dfe8a891-96cc-4583-beee-1577d25922ea\") "
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032173    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032271    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe8a891-96cc-4583-beee-1577d25922ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032317    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032461    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032567    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032584    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032616    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032631    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe8a891-96cc-4583-beee-1577d25922ea-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.032730 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.032639    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.034867 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.034806    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfe8a891-96cc-4583-beee-1577d25922ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:25:30.034990 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.034884    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:25:30.034990 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.034905    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-kube-api-access-hbndd" (OuterVolumeSpecName: "kube-api-access-hbndd") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "kube-api-access-hbndd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:25:30.040713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.040694    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfe8a891-96cc-4583-beee-1577d25922ea" (UID: "dfe8a891-96cc-4583-beee-1577d25922ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:25:30.133222 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.133201    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe8a891-96cc-4583-beee-1577d25922ea-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.133222 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.133223    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.133357 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.133234    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe8a891-96cc-4583-beee-1577d25922ea-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.133357 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.133242    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbndd\" (UniqueName: \"kubernetes.io/projected/dfe8a891-96cc-4583-beee-1577d25922ea-kube-api-access-hbndd\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:25:30.486119 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.486086    2564 generic.go:356] "Generic (PLEG): container finished" podID="dfe8a891-96cc-4583-beee-1577d25922ea" containerID="b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa" exitCode=0
Sep 04 22:25:30.486305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.486144    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"
Sep 04 22:25:30.486305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.486166    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" event={"ID":"dfe8a891-96cc-4583-beee-1577d25922ea","Type":"ContainerDied","Data":"b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa"}
Sep 04 22:25:30.486305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.486223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld" event={"ID":"dfe8a891-96cc-4583-beee-1577d25922ea","Type":"ContainerDied","Data":"a64ead10c73b36e1179b514cb4ea2a45f4aadac99c9168a72d3e0127348c02c3"}
Sep 04 22:25:30.486305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.486246    2564 scope.go:117] "RemoveContainer" containerID="b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa"
Sep 04 22:25:30.496347 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.496323    2564 scope.go:117] "RemoveContainer" containerID="1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a"
Sep 04 22:25:30.506990 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.506972    2564 scope.go:117] "RemoveContainer" containerID="b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa"
Sep 04 22:25:30.507269 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:25:30.507239    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa\": container with ID starting with b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa not found: ID does not exist" containerID="b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa"
Sep 04 22:25:30.507344 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.507278    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa"} err="failed to get container status \"b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa\": rpc error: code = NotFound desc = could not find container \"b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa\": container with ID starting with b44694848e98a0df7e2330e8e3b654a8c49c0fd2dc4d5be37c94f9cde244f6aa not found: ID does not exist"
Sep 04 22:25:30.507344 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.507293    2564 scope.go:117] "RemoveContainer" containerID="1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a"
Sep 04 22:25:30.507580 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:25:30.507554    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a\": container with ID starting with 1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a not found: ID does not exist" containerID="1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a"
Sep 04 22:25:30.507755 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.507591    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a"} err="failed to get container status \"1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a\": rpc error: code = NotFound desc = could not find container \"1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a\": container with ID starting with 1d29c65cf0ec9ec90d3421a205815758ba4d051ded266ccb5e30117695b9410a not found: ID does not exist"
Sep 04 22:25:30.510596 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.510574    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"]
Sep 04 22:25:30.517791 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.517769    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-25fea002-openshift-default-9f5d8c5f6-zclld"]
Sep 04 22:25:30.671990 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:25:30.671964    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" path="/var/lib/kubelet/pods/dfe8a891-96cc-4583-beee-1577d25922ea/volumes"
Sep 04 22:26:13.319844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.319808    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"]
Sep 04 22:26:13.320438 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320419    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy"
Sep 04 22:26:13.320486 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320440    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy"
Sep 04 22:26:13.320486 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320454    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33ec1901-d6b7-44cb-b363-1173db0c3098" containerName="payload-pre-processing"
Sep 04 22:26:13.320486 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320460    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ec1901-d6b7-44cb-b363-1173db0c3098" containerName="payload-pre-processing"
Sep 04 22:26:13.320576 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320555    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy"
Sep 04 22:26:13.320576 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320566    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy"
Sep 04 22:26:13.320673 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320575    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38029fb5-3dd9-4cf1-8079-40cba4483a14" containerName="istio-proxy"
Sep 04 22:26:13.320673 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.320582    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="33ec1901-d6b7-44cb-b363-1173db0c3098" containerName="payload-pre-processing"
Sep 04 22:26:13.325427 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.325402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.327771 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.327750    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-b91726-openshift-default-dockercfg-vlf24\""
Sep 04 22:26:13.334471 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.334448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"]
Sep 04 22:26:13.428432 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qktg\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-kube-api-access-9qktg\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428705 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b253726-fb32-470f-9a15-b354ce3641c0-istiod-ca-cert\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428705 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b253726-fb32-470f-9a15-b354ce3641c0-istio-podinfo\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428705 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-socket\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428705 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-istio-token\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428705 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-credential-socket\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-envoy\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428766    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-data\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.428925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.428817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-certs\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.529518 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-istio-token\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.529746 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-credential-socket\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.529746 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-envoy\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.529746 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-data\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.529746 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-certs\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.529746 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qktg\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-kube-api-access-9qktg\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.529746 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b253726-fb32-470f-9a15-b354ce3641c0-istiod-ca-cert\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.530082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b253726-fb32-470f-9a15-b354ce3641c0-istio-podinfo\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.530082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.529808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-socket\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.530082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.530007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-data\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.530082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.530020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-credential-socket\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.530297 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.530171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-socket\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.530297 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.530236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-certs\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.530523 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.530502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b253726-fb32-470f-9a15-b354ce3641c0-istiod-ca-cert\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.531940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.531913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-envoy\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.532241 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.532220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b253726-fb32-470f-9a15-b354ce3641c0-istio-podinfo\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.538200 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.538175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-istio-token\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.538627 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.538564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qktg\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-kube-api-access-9qktg\") pod \"e2e-explicit-b91726-openshift-default-655476b444-nb7fq\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") " pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.638066 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.637994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:13.918322 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.918293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"]
Sep 04 22:26:13.919917 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:26:13.919887    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b253726_fb32_470f_9a15_b354ce3641c0.slice/crio-32ccadf8f234a0bb2af25e4bde74763f37b192096221a4f37c76875367044342 WatchSource:0}: Error finding container 32ccadf8f234a0bb2af25e4bde74763f37b192096221a4f37c76875367044342: Status 404 returned error can't find the container with id 32ccadf8f234a0bb2af25e4bde74763f37b192096221a4f37c76875367044342
Sep 04 22:26:13.922324 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.922280    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:26:13.922398 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.922380    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:26:13.922439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:13.922429    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:26:14.722299 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:14.722261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" event={"ID":"7b253726-fb32-470f-9a15-b354ce3641c0","Type":"ContainerStarted","Data":"90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba"}
Sep 04 22:26:14.722721 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:14.722320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" event={"ID":"7b253726-fb32-470f-9a15-b354ce3641c0","Type":"ContainerStarted","Data":"32ccadf8f234a0bb2af25e4bde74763f37b192096221a4f37c76875367044342"}
Sep 04 22:26:14.743360 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:14.743306    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" podStartSLOduration=1.7432868529999999 podStartE2EDuration="1.743286853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:26:14.742797136 +0000 UTC m=+1048.547154662" watchObservedRunningTime="2026-09-04 22:26:14.743286853 +0000 UTC m=+1048.547644377"
Sep 04 22:26:15.638126 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:15.638094    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:15.643420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:15.643390    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:15.727868 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:15.727841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:15.728755 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:15.728735    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:36.842000 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:36.841964    2564 generic.go:356] "Generic (PLEG): container finished" podID="7b253726-fb32-470f-9a15-b354ce3641c0" containerID="90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba" exitCode=0
Sep 04 22:26:36.842525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:36.842011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" event={"ID":"7b253726-fb32-470f-9a15-b354ce3641c0","Type":"ContainerDied","Data":"90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba"}
Sep 04 22:26:36.842525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:36.842432    2564 scope.go:117] "RemoveContainer" containerID="90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba"
Sep 04 22:26:36.843543 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:36.843512    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:26:36.843630 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:36.843587    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:26:36.843695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:36.843645    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:26:37.850310 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:37.850277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" event={"ID":"7b253726-fb32-470f-9a15-b354ce3641c0","Type":"ContainerStarted","Data":"a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71"}
Sep 04 22:26:38.638768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:38.638730    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:38.638992 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:38.638943    2564 patch_prober.go:28] interesting pod/e2e-explicit-b91726-openshift-default-655476b444-nb7fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:26:38.639066 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:38.639002    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 04 22:26:39.638754 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:39.638712    2564 patch_prober.go:28] interesting pod/e2e-explicit-b91726-openshift-default-655476b444-nb7fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:26:39.639318 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:39.639287    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 04 22:26:40.377716 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:40.377677    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"]
Sep 04 22:26:40.639380 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:40.639281    2564 patch_prober.go:28] interesting pod/e2e-explicit-b91726-openshift-default-655476b444-nb7fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:26:40.639380 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:40.639353    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 04 22:26:41.639288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:41.638849    2564 patch_prober.go:28] interesting pod/e2e-explicit-b91726-openshift-default-655476b444-nb7fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:26:41.639288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:41.638913    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 04 22:26:42.639049 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:42.639011    2564 patch_prober.go:28] interesting pod/e2e-explicit-b91726-openshift-default-655476b444-nb7fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 04 22:26:42.639357 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:42.639317    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 04 22:26:43.745798 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:43.745761    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:43.746360 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:43.746337    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:43.747923 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:43.747904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:26:55.401441 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.401374    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm" podUID="5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" containerName="main" containerID="cri-o://b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c" gracePeriod=45
Sep 04 22:26:55.660960 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.660907    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:26:55.737574 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.737543    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6kxt\" (UniqueName: \"kubernetes.io/projected/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-kube-api-access-r6kxt\") pod \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") "
Sep 04 22:26:55.737574 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.737576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-home\") pod \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") "
Sep 04 22:26:55.737781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.737698    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-dshm\") pod \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") "
Sep 04 22:26:55.737781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.737738    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-model-cache\") pod \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") "
Sep 04 22:26:55.737781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.737775    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tls-certs\") pod \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") "
Sep 04 22:26:55.737938 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.737816    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tmp-dir\") pod \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\" (UID: \"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7\") "
Sep 04 22:26:55.737938 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.737901    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-home" (OuterVolumeSpecName: "home") pod "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" (UID: "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:26:55.738102 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.738078    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" (UID: "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:26:55.738214 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.738193    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tmp-dir\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:26:55.738287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.738217    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-home\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:26:55.738343 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.738285    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" (UID: "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:26:55.740037 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.740010    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" (UID: "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:26:55.740196 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.740174    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-dshm" (OuterVolumeSpecName: "dshm") pod "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" (UID: "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:26:55.740275 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.740208    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-kube-api-access-r6kxt" (OuterVolumeSpecName: "kube-api-access-r6kxt") pod "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" (UID: "5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7"). InnerVolumeSpecName "kube-api-access-r6kxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:26:55.839106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.839060    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-dshm\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:26:55.839106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.839098    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-model-cache\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:26:55.839106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.839114    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-tls-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:26:55.839424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.839128    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6kxt\" (UniqueName: \"kubernetes.io/projected/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7-kube-api-access-r6kxt\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:26:55.950261 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.950168    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" containerID="b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c" exitCode=0
Sep 04 22:26:55.950261 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.950213    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"
Sep 04 22:26:55.950512 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.950259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm" event={"ID":"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7","Type":"ContainerDied","Data":"b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c"}
Sep 04 22:26:55.950512 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.950308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm" event={"ID":"5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7","Type":"ContainerDied","Data":"9d47695f000f70036b069dcc1284dcf33bb3c2df2f3551ec4fefab998f22a1d1"}
Sep 04 22:26:55.950512 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.950329    2564 scope.go:117] "RemoveContainer" containerID="b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c"
Sep 04 22:26:55.960106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.960078    2564 scope.go:117] "RemoveContainer" containerID="b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c"
Sep 04 22:26:55.960357 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:26:55.960339    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c\": container with ID starting with b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c not found: ID does not exist" containerID="b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c"
Sep 04 22:26:55.960406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.960369    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c"} err="failed to get container status \"b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c\": rpc error: code = NotFound desc = could not find container \"b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c\": container with ID starting with b6390f639fe9165dda5fb16a9a0aa1be88dcc19f01200609ae8ac7034e27c43c not found: ID does not exist"
Sep 04 22:26:55.971846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.971824    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"]
Sep 04 22:26:55.976403 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:55.976382    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-8b0d12be-kserve-cb964d457-5mtqm"]
Sep 04 22:26:56.675090 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:26:56.675054    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" path="/var/lib/kubelet/pods/5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7/volumes"
Sep 04 22:27:03.043791 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.043757    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"]
Sep 04 22:27:03.044391 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.044372    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy"
Sep 04 22:27:03.044391 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.044392    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe8a891-96cc-4583-beee-1577d25922ea" containerName="istio-proxy"
Sep 04 22:27:03.044565 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.044427    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" containerName="main"
Sep 04 22:27:03.044565 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.044436    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" containerName="main"
Sep 04 22:27:03.044565 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.044523    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc7f9f1-1bc2-4f3e-ba4e-1614fc0721b7" containerName="main"
Sep 04 22:27:03.049588 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.049566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.052052 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.052033    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-84624e97-openshift-default-dockercfg-pnwwd\""
Sep 04 22:27:03.063153 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.063131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"]
Sep 04 22:27:03.205166 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-data\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-podinfo\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-token\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205440 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-certs\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205440 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-envoy\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205440 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2723e2d2-f265-4ddd-af17-fc005c35e71b-istiod-ca-cert\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205440 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-socket\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205564 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mdv\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-kube-api-access-v7mdv\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.205564 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.205485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-credential-socket\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-data\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-podinfo\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-token\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-certs\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-envoy\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2723e2d2-f265-4ddd-af17-fc005c35e71b-istiod-ca-cert\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-socket\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mdv\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-kube-api-access-v7mdv\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.306878 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.306815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-credential-socket\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.307238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.307016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-data\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.307238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.307079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-certs\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.307238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.307184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-socket\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.307238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.307202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-credential-socket\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.307557 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.307538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2723e2d2-f265-4ddd-af17-fc005c35e71b-istiod-ca-cert\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.309433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.309409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-envoy\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.309736 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.309717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-podinfo\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.315365 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.315338    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-token\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.315520 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.315498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mdv\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-kube-api-access-v7mdv\") pod \"e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") " pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.361687 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.361651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:03.646122 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.646055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"]
Sep 04 22:27:03.648362 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:27:03.648334    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2723e2d2_f265_4ddd_af17_fc005c35e71b.slice/crio-2ee05b4497265097b680e50d9e36366f4d0a574c37cf04ead0e5d46acd0bb82d WatchSource:0}: Error finding container 2ee05b4497265097b680e50d9e36366f4d0a574c37cf04ead0e5d46acd0bb82d: Status 404 returned error can't find the container with id 2ee05b4497265097b680e50d9e36366f4d0a574c37cf04ead0e5d46acd0bb82d
Sep 04 22:27:03.650958 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.650909    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:27:03.651079 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.651003    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:27:03.651079 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:03.651057    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:27:04.008464 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:04.008351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" event={"ID":"2723e2d2-f265-4ddd-af17-fc005c35e71b","Type":"ContainerStarted","Data":"4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2"}
Sep 04 22:27:04.008464 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:04.008442    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" event={"ID":"2723e2d2-f265-4ddd-af17-fc005c35e71b","Type":"ContainerStarted","Data":"2ee05b4497265097b680e50d9e36366f4d0a574c37cf04ead0e5d46acd0bb82d"}
Sep 04 22:27:04.065976 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:04.065909    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podStartSLOduration=1.065886963 podStartE2EDuration="1.065886963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:27:04.065859121 +0000 UTC m=+1097.870216646" watchObservedRunningTime="2026-09-04 22:27:04.065886963 +0000 UTC m=+1097.870244490"
Sep 04 22:27:04.362572 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:04.362537    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:04.367545 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:04.367512    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:05.013829 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:05.013787    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:05.014581 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:05.014564    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:21.054754 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:21.054716    2564 patch_prober.go:28] interesting pod/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:27:21.055135 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:21.054787    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:27:22.112445 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:22.112412    2564 generic.go:356] "Generic (PLEG): container finished" podID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerID="4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2" exitCode=0
Sep 04 22:27:22.112805 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:22.112485    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" event={"ID":"2723e2d2-f265-4ddd-af17-fc005c35e71b","Type":"ContainerDied","Data":"4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2"}
Sep 04 22:27:22.112907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:22.112892    2564 scope.go:117] "RemoveContainer" containerID="4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2"
Sep 04 22:27:22.113944 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:22.113918    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:27:22.114018 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:22.113986    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:27:22.114056 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:22.114017    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:27:23.119454 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:23.119416    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" event={"ID":"2723e2d2-f265-4ddd-af17-fc005c35e71b","Type":"ContainerStarted","Data":"30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848"}
Sep 04 22:27:23.362683 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:23.362637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:23.362989 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:23.362936    2564 patch_prober.go:28] interesting pod/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 04 22:27:23.363224 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:23.362997    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 04 22:27:24.362241 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:24.362202    2564 patch_prober.go:28] interesting pod/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 04 22:27:24.362762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:24.362268    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 04 22:27:25.362189 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:25.362156    2564 patch_prober.go:28] interesting pod/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 04 22:27:25.362441 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:25.362409    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 04 22:27:26.362478 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:26.362439    2564 patch_prober.go:28] interesting pod/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 04 22:27:26.363085 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:26.362576    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 04 22:27:27.362489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:27.362436    2564 patch_prober.go:28] interesting pod/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 04 22:27:27.363005 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:27.362508    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 04 22:27:28.365799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:28.365766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:28.366255 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:28.366126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:28.366688 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:28.366666    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:27:33.995580 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:33.995547    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"]
Sep 04 22:27:33.998068 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:33.998048    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.001349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.001314    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-b91726\"/\"openshift-service-ca.crt\""
Sep 04 22:27:34.001349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.001327    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-b91726\"/\"explicit-model-b91726-kserve-self-signed-certs\""
Sep 04 22:27:34.001349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.001317    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-b91726\"/\"default-dockercfg-xd6qz\""
Sep 04 22:27:34.001543 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.001348    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-b91726\"/\"kube-root-ca.crt\""
Sep 04 22:27:34.012067 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.012038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"]
Sep 04 22:27:34.097004 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.096966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.097172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.097077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkmb\" (UniqueName: \"kubernetes.io/projected/604f389f-1c0e-4d0f-abd9-8d054d911dda-kube-api-access-bxkmb\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.097172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.097125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-tmp-dir\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.097172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.097159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-dshm\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.097302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.097195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-model-cache\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.097302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.097250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-home\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.198582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.198548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-dshm\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.198803 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.198595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-model-cache\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.198803 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.198657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-home\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.198803 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.198689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.198803 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.198735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkmb\" (UniqueName: \"kubernetes.io/projected/604f389f-1c0e-4d0f-abd9-8d054d911dda-kube-api-access-bxkmb\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.198803 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.198761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-tmp-dir\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.199083 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.199018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-home\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.199083 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.199072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-model-cache\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.199168 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.199121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-tmp-dir\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.200752 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.200732    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-dshm\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.201104 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.201086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.208150 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.208127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkmb\" (UniqueName: \"kubernetes.io/projected/604f389f-1c0e-4d0f-abd9-8d054d911dda-kube-api-access-bxkmb\") pod \"explicit-model-b91726-kserve-fbf644899-82nrq\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") " pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.307174 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.307106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:34.578715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:34.578689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"]
Sep 04 22:27:34.580302 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:27:34.580275    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod604f389f_1c0e_4d0f_abd9_8d054d911dda.slice/crio-63ddcbab330a73321de4b5eca3ebe5daaff3ea53f9fd548bedbd61c11e7a62a2 WatchSource:0}: Error finding container 63ddcbab330a73321de4b5eca3ebe5daaff3ea53f9fd548bedbd61c11e7a62a2: Status 404 returned error can't find the container with id 63ddcbab330a73321de4b5eca3ebe5daaff3ea53f9fd548bedbd61c11e7a62a2
Sep 04 22:27:35.185359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:35.185320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq" event={"ID":"604f389f-1c0e-4d0f-abd9-8d054d911dda","Type":"ContainerStarted","Data":"b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76"}
Sep 04 22:27:35.185800 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:35.185373    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq" event={"ID":"604f389f-1c0e-4d0f-abd9-8d054d911dda","Type":"ContainerStarted","Data":"63ddcbab330a73321de4b5eca3ebe5daaff3ea53f9fd548bedbd61c11e7a62a2"}
Sep 04 22:27:35.203389 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:35.203333    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq" podStartSLOduration=2.203316725 podStartE2EDuration="2.203316725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:27:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:27:35.203064769 +0000 UTC m=+1129.007422324" watchObservedRunningTime="2026-09-04 22:27:35.203316725 +0000 UTC m=+1129.007674248"
Sep 04 22:27:44.307446 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:44.307404    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:44.307946 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:44.307477    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:44.320066 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:44.320046    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:44.487045 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:44.487011    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"]
Sep 04 22:27:45.251460 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:45.251431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:27:45.419832 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:45.419797    2564 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-self-signed-certs: secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:45.420180 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:45.419878    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs podName:604f389f-1c0e-4d0f-abd9-8d054d911dda nodeName:}" failed. No retries permitted until 2026-09-04 22:27:45.91985728 +0000 UTC m=+1139.724214791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs") pod "explicit-model-b91726-kserve-fbf644899-82nrq" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda") : secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:45.925174 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:45.925141    2564 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-self-signed-certs: secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:45.925337 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:45.925227    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs podName:604f389f-1c0e-4d0f-abd9-8d054d911dda nodeName:}" failed. No retries permitted until 2026-09-04 22:27:46.925206678 +0000 UTC m=+1140.729564180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs") pod "explicit-model-b91726-kserve-fbf644899-82nrq" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda") : secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:46.935324 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:46.935295    2564 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-self-signed-certs: secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:46.935674 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:46.935357    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs podName:604f389f-1c0e-4d0f-abd9-8d054d911dda nodeName:}" failed. No retries permitted until 2026-09-04 22:27:48.935344461 +0000 UTC m=+1142.739701973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs") pod "explicit-model-b91726-kserve-fbf644899-82nrq" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda") : secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:48.955160 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:48.955127    2564 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-self-signed-certs: secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:48.955518 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:48.955206    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs podName:604f389f-1c0e-4d0f-abd9-8d054d911dda nodeName:}" failed. No retries permitted until 2026-09-04 22:27:52.95519141 +0000 UTC m=+1146.759548917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs") pod "explicit-model-b91726-kserve-fbf644899-82nrq" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda") : secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:52.992349 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:52.992317    2564 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-self-signed-certs: secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:52.992716 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:27:52.992391    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs podName:604f389f-1c0e-4d0f-abd9-8d054d911dda nodeName:}" failed. No retries permitted until 2026-09-04 22:28:00.992374233 +0000 UTC m=+1154.796731934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs") pod "explicit-model-b91726-kserve-fbf644899-82nrq" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda") : secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:27:57.377494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:57.377461    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"]
Sep 04 22:27:57.377953 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:57.377765    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" containerID="cri-o://30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848" gracePeriod=30
Sep 04 22:27:58.368469 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:58.368435    2564 patch_prober.go:28] interesting pod/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:27:58.368707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:27:58.368522    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:28:01.078098 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:01.078067    2564 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-self-signed-certs: secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:28:01.078458 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:01.078142    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs podName:604f389f-1c0e-4d0f-abd9-8d054d911dda nodeName:}" failed. No retries permitted until 2026-09-04 22:28:17.078124809 +0000 UTC m=+1170.882482314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs") pod "explicit-model-b91726-kserve-fbf644899-82nrq" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda") : secret "explicit-model-b91726-kserve-self-signed-certs" not found
Sep 04 22:28:01.265374 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.265328    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq" podUID="604f389f-1c0e-4d0f-abd9-8d054d911dda" containerName="main" containerID="cri-o://b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76" gracePeriod=45
Sep 04 22:28:01.518761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.518736    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:28:01.583254 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583220    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-model-cache\") pod \"604f389f-1c0e-4d0f-abd9-8d054d911dda\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") "
Sep 04 22:28:01.583254 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxkmb\" (UniqueName: \"kubernetes.io/projected/604f389f-1c0e-4d0f-abd9-8d054d911dda-kube-api-access-bxkmb\") pod \"604f389f-1c0e-4d0f-abd9-8d054d911dda\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") "
Sep 04 22:28:01.583480 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583271    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-home\") pod \"604f389f-1c0e-4d0f-abd9-8d054d911dda\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") "
Sep 04 22:28:01.583480 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583356    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs\") pod \"604f389f-1c0e-4d0f-abd9-8d054d911dda\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") "
Sep 04 22:28:01.583480 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583410    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-dshm\") pod \"604f389f-1c0e-4d0f-abd9-8d054d911dda\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") "
Sep 04 22:28:01.583480 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583477    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-tmp-dir\") pod \"604f389f-1c0e-4d0f-abd9-8d054d911dda\" (UID: \"604f389f-1c0e-4d0f-abd9-8d054d911dda\") "
Sep 04 22:28:01.583749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583512    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-model-cache" (OuterVolumeSpecName: "model-cache") pod "604f389f-1c0e-4d0f-abd9-8d054d911dda" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:01.583749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583553    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-home" (OuterVolumeSpecName: "home") pod "604f389f-1c0e-4d0f-abd9-8d054d911dda" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:01.583845 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583825    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "604f389f-1c0e-4d0f-abd9-8d054d911dda" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:01.583887 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583846    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-model-cache\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:01.583887 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.583861    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-home\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:01.585504 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.585474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-dshm" (OuterVolumeSpecName: "dshm") pod "604f389f-1c0e-4d0f-abd9-8d054d911dda" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:01.585636 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.585548    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604f389f-1c0e-4d0f-abd9-8d054d911dda-kube-api-access-bxkmb" (OuterVolumeSpecName: "kube-api-access-bxkmb") pod "604f389f-1c0e-4d0f-abd9-8d054d911dda" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda"). InnerVolumeSpecName "kube-api-access-bxkmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:01.585636 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.585555    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "604f389f-1c0e-4d0f-abd9-8d054d911dda" (UID: "604f389f-1c0e-4d0f-abd9-8d054d911dda"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:28:01.684825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.684735    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/604f389f-1c0e-4d0f-abd9-8d054d911dda-tls-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:01.684825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.684767    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-dshm\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:01.684825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.684776    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/604f389f-1c0e-4d0f-abd9-8d054d911dda-tmp-dir\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:01.684825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:01.684785    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxkmb\" (UniqueName: \"kubernetes.io/projected/604f389f-1c0e-4d0f-abd9-8d054d911dda-kube-api-access-bxkmb\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.332876 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.332838    2564 generic.go:356] "Generic (PLEG): container finished" podID="604f389f-1c0e-4d0f-abd9-8d054d911dda" containerID="b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76" exitCode=0
Sep 04 22:28:02.332876 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.332880    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"
Sep 04 22:28:02.333399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.332919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq" event={"ID":"604f389f-1c0e-4d0f-abd9-8d054d911dda","Type":"ContainerDied","Data":"b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76"}
Sep 04 22:28:02.333399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.332959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq" event={"ID":"604f389f-1c0e-4d0f-abd9-8d054d911dda","Type":"ContainerDied","Data":"63ddcbab330a73321de4b5eca3ebe5daaff3ea53f9fd548bedbd61c11e7a62a2"}
Sep 04 22:28:02.333399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.332976    2564 scope.go:117] "RemoveContainer" containerID="b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76"
Sep 04 22:28:02.343359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.343342    2564 scope.go:117] "RemoveContainer" containerID="b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76"
Sep 04 22:28:02.343719 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:02.343687    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76\": container with ID starting with b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76 not found: ID does not exist" containerID="b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76"
Sep 04 22:28:02.343817 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.343728    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76"} err="failed to get container status \"b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76\": rpc error: code = NotFound desc = could not find container \"b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76\": container with ID starting with b64d41fbcdb2a25cf2e77bf859a1388f986aa20cd7fc48f33e98773c033e9f76 not found: ID does not exist"
Sep 04 22:28:02.356324 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.356296    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"]
Sep 04 22:28:02.361163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.361143    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-b91726/explicit-model-b91726-kserve-fbf644899-82nrq"]
Sep 04 22:28:02.656341 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.656311    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:28:02.671264 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.671239    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604f389f-1c0e-4d0f-abd9-8d054d911dda" path="/var/lib/kubelet/pods/604f389f-1c0e-4d0f-abd9-8d054d911dda/volumes"
Sep 04 22:28:02.794485 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7mdv\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-kube-api-access-v7mdv\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794485 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794489    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-token\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794741 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-certs\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794741 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794530    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-data\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794741 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-socket\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794741 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794720    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-podinfo\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794951 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-envoy\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794951 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794783    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2723e2d2-f265-4ddd-af17-fc005c35e71b-istiod-ca-cert\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794951 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794813    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-credential-socket\") pod \"2723e2d2-f265-4ddd-af17-fc005c35e71b\" (UID: \"2723e2d2-f265-4ddd-af17-fc005c35e71b\") "
Sep 04 22:28:02.794951 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794844    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:02.794951 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794873    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:02.795198 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.794960    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:02.795198 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.795082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:02.795198 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.795135    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2723e2d2-f265-4ddd-af17-fc005c35e71b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:28:02.795370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.795204    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.795370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.795216    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.795370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.795225    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.795370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.795237    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.796927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.796896    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:02.797073 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.797019    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:02.797239 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.797216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:28:02.797363 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.797348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-kube-api-access-v7mdv" (OuterVolumeSpecName: "kube-api-access-v7mdv") pod "2723e2d2-f265-4ddd-af17-fc005c35e71b" (UID: "2723e2d2-f265-4ddd-af17-fc005c35e71b"). InnerVolumeSpecName "kube-api-access-v7mdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:02.895918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.895855    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.895918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.895881    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.895918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.895890    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2723e2d2-f265-4ddd-af17-fc005c35e71b-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.895918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.895898    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7mdv\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-kube-api-access-v7mdv\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:02.895918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:02.895908    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2723e2d2-f265-4ddd-af17-fc005c35e71b-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:03.341121 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.341084    2564 generic.go:356] "Generic (PLEG): container finished" podID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerID="30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848" exitCode=0
Sep 04 22:28:03.341549 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.341141    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"
Sep 04 22:28:03.341549 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.341173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" event={"ID":"2723e2d2-f265-4ddd-af17-fc005c35e71b","Type":"ContainerDied","Data":"30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848"}
Sep 04 22:28:03.341549 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.341269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8" event={"ID":"2723e2d2-f265-4ddd-af17-fc005c35e71b","Type":"ContainerDied","Data":"2ee05b4497265097b680e50d9e36366f4d0a574c37cf04ead0e5d46acd0bb82d"}
Sep 04 22:28:03.341549 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.341299    2564 scope.go:117] "RemoveContainer" containerID="30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848"
Sep 04 22:28:03.350432 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.350415    2564 scope.go:117] "RemoveContainer" containerID="4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2"
Sep 04 22:28:03.358969 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.358947    2564 scope.go:117] "RemoveContainer" containerID="30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848"
Sep 04 22:28:03.359234 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:03.359215    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848\": container with ID starting with 30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848 not found: ID does not exist" containerID="30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848"
Sep 04 22:28:03.359287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.359242    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848"} err="failed to get container status \"30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848\": rpc error: code = NotFound desc = could not find container \"30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848\": container with ID starting with 30abc0ce3b4807b681c3ce5e553ffc39c6254457034b05a5a4e04bb1491dd848 not found: ID does not exist"
Sep 04 22:28:03.359287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.359259    2564 scope.go:117] "RemoveContainer" containerID="4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2"
Sep 04 22:28:03.359493 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:03.359479    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2\": container with ID starting with 4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2 not found: ID does not exist" containerID="4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2"
Sep 04 22:28:03.359541 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.359495    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2"} err="failed to get container status \"4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2\": rpc error: code = NotFound desc = could not find container \"4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2\": container with ID starting with 4d783989eebcaf5b26a19e4acdb98218df1d5db5596134a5d7325c2bb4366bc2 not found: ID does not exist"
Sep 04 22:28:03.364656 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.364633    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"]
Sep 04 22:28:03.373678 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:03.373060    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-84624e97-openshift-default-6bdc76ddb4-924s8"]
Sep 04 22:28:04.671035 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:04.671005    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" path="/var/lib/kubelet/pods/2723e2d2-f265-4ddd-af17-fc005c35e71b/volumes"
Sep 04 22:28:08.078459 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:08.078427    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"]
Sep 04 22:28:08.078938 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:08.078702    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy" containerID="cri-o://a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71" gracePeriod=30
Sep 04 22:28:12.982327 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982241    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"]
Sep 04 22:28:12.982750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982666    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy"
Sep 04 22:28:12.982750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982680    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy"
Sep 04 22:28:12.982750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982692    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604f389f-1c0e-4d0f-abd9-8d054d911dda" containerName="main"
Sep 04 22:28:12.982750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982698    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="604f389f-1c0e-4d0f-abd9-8d054d911dda" containerName="main"
Sep 04 22:28:12.982750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982710    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy"
Sep 04 22:28:12.982750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982716    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy"
Sep 04 22:28:12.982957 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982781    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy"
Sep 04 22:28:12.982957 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.982789    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="604f389f-1c0e-4d0f-abd9-8d054d911dda" containerName="main"
Sep 04 22:28:12.987376 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.987358    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:12.989928 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.989908    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-e64d5c\"/\"kube-root-ca.crt\""
Sep 04 22:28:12.990670 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.990648    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-e64d5c\"/\"noten-model-e64d5c-kserve-self-signed-certs\""
Sep 04 22:28:12.990739 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.990659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-e64d5c\"/\"default-dockercfg-gr5wj\""
Sep 04 22:28:12.990739 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.990658    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-e64d5c\"/\"openshift-service-ca.crt\""
Sep 04 22:28:12.995783 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:12.995762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"]
Sep 04 22:28:13.094826 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.094790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-home\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.094951 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.094845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tmp-dir\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.094999 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.094977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwbmq\" (UniqueName: \"kubernetes.io/projected/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-kube-api-access-pwbmq\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.095061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.095043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-dshm\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.095115 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.095099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tls-certs\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.095208 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.095193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-model-cache\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tmp-dir\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196443 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbmq\" (UniqueName: \"kubernetes.io/projected/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-kube-api-access-pwbmq\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196443 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-dshm\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196571 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tls-certs\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196571 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-model-cache\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-home\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tmp-dir\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.196939 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-model-cache\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.197004 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.196919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-home\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.198457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.198434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-dshm\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.199121 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.199097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tls-certs\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.206020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.205994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwbmq\" (UniqueName: \"kubernetes.io/projected/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-kube-api-access-pwbmq\") pod \"noten-model-e64d5c-kserve-5f558595f-ll46t\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") " pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.298654 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.298210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:13.353003 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.352715    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:28:13.396774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.396668    2564 generic.go:356] "Generic (PLEG): container finished" podID="7b253726-fb32-470f-9a15-b354ce3641c0" containerID="a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71" exitCode=0
Sep 04 22:28:13.396774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.396774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" event={"ID":"7b253726-fb32-470f-9a15-b354ce3641c0","Type":"ContainerDied","Data":"a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71"}
Sep 04 22:28:13.397052 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.396828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq" event={"ID":"7b253726-fb32-470f-9a15-b354ce3641c0","Type":"ContainerDied","Data":"32ccadf8f234a0bb2af25e4bde74763f37b192096221a4f37c76875367044342"}
Sep 04 22:28:13.397052 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.396861    2564 scope.go:117] "RemoveContainer" containerID="a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71"
Sep 04 22:28:13.397052 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.397028    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"
Sep 04 22:28:13.408131 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.408043    2564 scope.go:117] "RemoveContainer" containerID="90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba"
Sep 04 22:28:13.419401 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.419379    2564 scope.go:117] "RemoveContainer" containerID="a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71"
Sep 04 22:28:13.419747 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:13.419726    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71\": container with ID starting with a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71 not found: ID does not exist" containerID="a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71"
Sep 04 22:28:13.419825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.419757    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71"} err="failed to get container status \"a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71\": rpc error: code = NotFound desc = could not find container \"a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71\": container with ID starting with a507d7e8115b8b161b19502f84a6cecf2abedcf7483d145cc114cc280f1dbf71 not found: ID does not exist"
Sep 04 22:28:13.419825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.419777    2564 scope.go:117] "RemoveContainer" containerID="90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba"
Sep 04 22:28:13.420064 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:13.420048    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba\": container with ID starting with 90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba not found: ID does not exist" containerID="90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba"
Sep 04 22:28:13.420110 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.420070    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba"} err="failed to get container status \"90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba\": rpc error: code = NotFound desc = could not find container \"90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba\": container with ID starting with 90c748af485bde5c610b991657dd0a4014d752e61a60a2b9d24225f7e5da1fba not found: ID does not exist"
Sep 04 22:28:13.459779 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.459742    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"]
Sep 04 22:28:13.460170 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.460157    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy"
Sep 04 22:28:13.460170 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.460171    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy"
Sep 04 22:28:13.460302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.460210    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy"
Sep 04 22:28:13.460302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.460216    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy"
Sep 04 22:28:13.460302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.460279    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2723e2d2-f265-4ddd-af17-fc005c35e71b" containerName="istio-proxy"
Sep 04 22:28:13.460302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.460290    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy"
Sep 04 22:28:13.460302 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.460295    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" containerName="istio-proxy"
Sep 04 22:28:13.472114 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.472083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.475144 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.474855    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-f64b20-openshift-default-dockercfg-94jvz\""
Sep 04 22:28:13.475937 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.475908    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"]
Sep 04 22:28:13.499069 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499040    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-data\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499069 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499071    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-certs\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499109    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-credential-socket\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499155    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-socket\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qktg\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-kube-api-access-9qktg\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499285    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-istio-token\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499325    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b253726-fb32-470f-9a15-b354ce3641c0-istio-podinfo\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499346    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:13.499439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499366    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-envoy\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499382    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:13.499439 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499395    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b253726-fb32-470f-9a15-b354ce3641c0-istiod-ca-cert\") pod \"7b253726-fb32-470f-9a15-b354ce3641c0\" (UID: \"7b253726-fb32-470f-9a15-b354ce3641c0\") "
Sep 04 22:28:13.499767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499551    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:13.499767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499564    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:13.499767 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499720    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b253726-fb32-470f-9a15-b354ce3641c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:28:13.499886 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499840    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.499886 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499855    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b253726-fb32-470f-9a15-b354ce3641c0-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.499886 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499868    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.499996 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499885    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.499996 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.499902    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.501641 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.501591    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:13.501760 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.501652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b253726-fb32-470f-9a15-b354ce3641c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:28:13.502130 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.502102    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:13.502634 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.502179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-kube-api-access-9qktg" (OuterVolumeSpecName: "kube-api-access-9qktg") pod "7b253726-fb32-470f-9a15-b354ce3641c0" (UID: "7b253726-fb32-470f-9a15-b354ce3641c0"). InnerVolumeSpecName "kube-api-access-9qktg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:13.593689 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.593653    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"]
Sep 04 22:28:13.595951 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:28:13.595924    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3fbd99c_8f3d_4ffc_bc1b_d04684fb9556.slice/crio-21fdca3aa7554613494614dddc70890fb7fa0d16026f657f922830f072201164 WatchSource:0}: Error finding container 21fdca3aa7554613494614dddc70890fb7fa0d16026f657f922830f072201164: Status 404 returned error can't find the container with id 21fdca3aa7554613494614dddc70890fb7fa0d16026f657f922830f072201164
Sep 04 22:28:13.601039 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-certs\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601096 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-istio-token\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601096 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601068    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dpj7\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-kube-api-access-7dpj7\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601096 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-credential-socket\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601197 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-data\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601231 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-envoy\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601231 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73378b07-5422-4af2-a780-b1048478ca2b-istiod-ca-cert\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601323 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73378b07-5422-4af2-a780-b1048478ca2b-istio-podinfo\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-socket\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.601425 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601412    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qktg\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-kube-api-access-9qktg\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.601469 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601427    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b253726-fb32-470f-9a15-b354ce3641c0-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.601469 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601437    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b253726-fb32-470f-9a15-b354ce3641c0-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.601469 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.601445    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b253726-fb32-470f-9a15-b354ce3641c0-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:13.702238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-data\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-envoy\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73378b07-5422-4af2-a780-b1048478ca2b-istiod-ca-cert\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73378b07-5422-4af2-a780-b1048478ca2b-istio-podinfo\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-socket\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-certs\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-istio-token\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dpj7\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-kube-api-access-7dpj7\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-credential-socket\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.702761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.702671    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-data\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.703034 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.703006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-socket\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.703268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.703175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-certs\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.703268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.703209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73378b07-5422-4af2-a780-b1048478ca2b-istiod-ca-cert\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.703384 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.703266    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-credential-socket\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.704968 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.704916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73378b07-5422-4af2-a780-b1048478ca2b-istio-podinfo\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.705095 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.704965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-envoy\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.714839 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.714810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-istio-token\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.714839 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.714822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dpj7\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-kube-api-access-7dpj7\") pod \"e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") " pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:13.723561 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.723524    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"]
Sep 04 22:28:13.726300 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.726277    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-b91726-openshift-default-655476b444-nb7fq"]
Sep 04 22:28:13.785377 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:13.785348    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:14.069883 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.069855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"]
Sep 04 22:28:14.071450 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:28:14.071422    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73378b07_5422_4af2_a780_b1048478ca2b.slice/crio-ed43bc8ebe31f7652201c11b0d61ff408a73249ca7cbb9a86c32cb4050a7780a WatchSource:0}: Error finding container ed43bc8ebe31f7652201c11b0d61ff408a73249ca7cbb9a86c32cb4050a7780a: Status 404 returned error can't find the container with id ed43bc8ebe31f7652201c11b0d61ff408a73249ca7cbb9a86c32cb4050a7780a
Sep 04 22:28:14.073892 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.073858    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:28:14.073976 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.073929    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:28:14.073976 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.073956    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:28:14.403974 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.403878    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" event={"ID":"73378b07-5422-4af2-a780-b1048478ca2b","Type":"ContainerStarted","Data":"7398819c3c0061dd33f4214ada99ac854dd8277f1936514dcc9526a7edde4eb3"}
Sep 04 22:28:14.403974 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.403937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" event={"ID":"73378b07-5422-4af2-a780-b1048478ca2b","Type":"ContainerStarted","Data":"ed43bc8ebe31f7652201c11b0d61ff408a73249ca7cbb9a86c32cb4050a7780a"}
Sep 04 22:28:14.405883 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.405855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t" event={"ID":"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556","Type":"ContainerStarted","Data":"c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802"}
Sep 04 22:28:14.405998 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.405893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t" event={"ID":"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556","Type":"ContainerStarted","Data":"21fdca3aa7554613494614dddc70890fb7fa0d16026f657f922830f072201164"}
Sep 04 22:28:14.423894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.423836    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podStartSLOduration=1.423816023 podStartE2EDuration="1.423816023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:28:14.423113194 +0000 UTC m=+1168.227470731" watchObservedRunningTime="2026-09-04 22:28:14.423816023 +0000 UTC m=+1168.228173547"
Sep 04 22:28:14.442341 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.442280    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t" podStartSLOduration=2.442262601 podStartE2EDuration="2.442262601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:28:14.440381896 +0000 UTC m=+1168.244739421" watchObservedRunningTime="2026-09-04 22:28:14.442262601 +0000 UTC m=+1168.246620125"
Sep 04 22:28:14.672595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.672514    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b253726-fb32-470f-9a15-b354ce3641c0" path="/var/lib/kubelet/pods/7b253726-fb32-470f-9a15-b354ce3641c0/volumes"
Sep 04 22:28:14.785847 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.785813    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:14.945053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.944971    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"]
Sep 04 22:28:14.945268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:14.945238    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk" podUID="3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" containerName="maas-api" containerID="cri-o://8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c" gracePeriod=30
Sep 04 22:28:15.204329 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.204271    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:28:15.319926 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.319872    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls\") pod \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") "
Sep 04 22:28:15.320131 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.319943    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxhfw\" (UniqueName: \"kubernetes.io/projected/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-kube-api-access-pxhfw\") pod \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") "
Sep 04 22:28:15.320131 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.319965    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-metrics-certs\") pod \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") "
Sep 04 22:28:15.320131 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.320043    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-openshift-service-ca\") pod \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\" (UID: \"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9\") "
Sep 04 22:28:15.320467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.320442    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" (UID: "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:28:15.322032 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.322008    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" (UID: "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:28:15.322120 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.322034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" (UID: "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:28:15.322120 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.322069    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-kube-api-access-pxhfw" (OuterVolumeSpecName: "kube-api-access-pxhfw") pod "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" (UID: "3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9"). InnerVolumeSpecName "kube-api-access-pxhfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:15.415810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.415773    2564 generic.go:356] "Generic (PLEG): container finished" podID="3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" containerID="8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c" exitCode=0
Sep 04 22:28:15.415810 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.415816    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"
Sep 04 22:28:15.416051 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.415863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk" event={"ID":"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9","Type":"ContainerDied","Data":"8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c"}
Sep 04 22:28:15.416051 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.415928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk" event={"ID":"3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9","Type":"ContainerDied","Data":"82d7efb9bd784aa3218600ca8530ee27287e319e8345cfa91a2d38052c786da9"}
Sep 04 22:28:15.416051 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.415963    2564 scope.go:117] "RemoveContainer" containerID="8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c"
Sep 04 22:28:15.421305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.421273    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:15.421421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.421308    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxhfw\" (UniqueName: \"kubernetes.io/projected/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-kube-api-access-pxhfw\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:15.421421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.421323    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:15.421421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.421338    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:15.429969 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.429831    2564 scope.go:117] "RemoveContainer" containerID="8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c"
Sep 04 22:28:15.430442 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:15.430421    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c\": container with ID starting with 8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c not found: ID does not exist" containerID="8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c"
Sep 04 22:28:15.430530 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.430453    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c"} err="failed to get container status \"8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c\": rpc error: code = NotFound desc = could not find container \"8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c\": container with ID starting with 8440b04dfc2750efb6a92374fd649f2ce2af4be87196fc282ee5ce6b0cc6b83c not found: ID does not exist"
Sep 04 22:28:15.441238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.441206    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"]
Sep 04 22:28:15.444944 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.444920    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d9f7ae-7476cc8f68-q8xvk"]
Sep 04 22:28:15.793212 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:15.793176    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:16.423272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:16.423237    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:16.424711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:16.424688    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:16.671678 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:16.671645    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" path="/var/lib/kubelet/pods/3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9/volumes"
Sep 04 22:28:17.710435 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.710402    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"]
Sep 04 22:28:17.710927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.710853    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" containerName="maas-api"
Sep 04 22:28:17.710927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.710865    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" containerName="maas-api"
Sep 04 22:28:17.710927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.710925    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ea5fae1-6dc3-4c1e-8bb5-b3ae131e9cd9" containerName="maas-api"
Sep 04 22:28:17.715311 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.715288    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.717589 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.717559    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-f64b20-serving-cert\""
Sep 04 22:28:17.725802 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.725771    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"]
Sep 04 22:28:17.845956 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.845915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/354cf6d8-8e2f-4361-97f9-45455761c8e5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.845956 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.845958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.846246 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.846149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbz77\" (UniqueName: \"kubernetes.io/projected/354cf6d8-8e2f-4361-97f9-45455761c8e5-kube-api-access-hbz77\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.846246 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.846192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.946864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.946824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbz77\" (UniqueName: \"kubernetes.io/projected/354cf6d8-8e2f-4361-97f9-45455761c8e5-kube-api-access-hbz77\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.946864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.946869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.947129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.946896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/354cf6d8-8e2f-4361-97f9-45455761c8e5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.947129 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.946914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.947129 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:17.947043    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-serving-cert: secret "maas-api-e2e-shared-a-w2-f64b20-serving-cert" not found
Sep 04 22:28:17.947320 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:17.947138    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls podName:354cf6d8-8e2f-4361-97f9-45455761c8e5 nodeName:}" failed. No retries permitted until 2026-09-04 22:28:18.447120635 +0000 UTC m=+1172.251478137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls") pod "maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s" (UID: "354cf6d8-8e2f-4361-97f9-45455761c8e5") : secret "maas-api-e2e-shared-a-w2-f64b20-serving-cert" not found
Sep 04 22:28:17.947559 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.947539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/354cf6d8-8e2f-4361-97f9-45455761c8e5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.949571 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.949544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:17.957567 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:17.957542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbz77\" (UniqueName: \"kubernetes.io/projected/354cf6d8-8e2f-4361-97f9-45455761c8e5-kube-api-access-hbz77\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:18.116344 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:18.116312    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"]
Sep 04 22:28:18.452573 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:18.452497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:18.454957 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:18.454930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:18.628264 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:18.628232    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:18.914444 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:18.914415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"]
Sep 04 22:28:18.916331 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:28:18.916304    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354cf6d8_8e2f_4361_97f9_45455761c8e5.slice/crio-380358e99fd17ada840ef31a841da82950db950a35de81fa0d5e380c6a667560 WatchSource:0}: Error finding container 380358e99fd17ada840ef31a841da82950db950a35de81fa0d5e380c6a667560: Status 404 returned error can't find the container with id 380358e99fd17ada840ef31a841da82950db950a35de81fa0d5e380c6a667560
Sep 04 22:28:18.917688 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:18.917673    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:28:19.443317 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:19.443268    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s" event={"ID":"354cf6d8-8e2f-4361-97f9-45455761c8e5","Type":"ContainerStarted","Data":"d93501d2c6b7c715f94fb11410fa757411e3f096c74bc8ca38149acbe46fd1b0"}
Sep 04 22:28:19.443490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:19.443338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s" event={"ID":"354cf6d8-8e2f-4361-97f9-45455761c8e5","Type":"ContainerStarted","Data":"380358e99fd17ada840ef31a841da82950db950a35de81fa0d5e380c6a667560"}
Sep 04 22:28:19.443490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:19.443467    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:19.462841 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:19.462798    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s" podStartSLOduration=2.066420377 podStartE2EDuration="2.462781733s" totalImagesPullingTime="396.361356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:28:19.461273367 +0000 UTC m=+1173.265630891" watchObservedRunningTime="2026-09-04 22:28:19.462781733 +0000 UTC m=+1173.267139257"
Sep 04 22:28:22.622882 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:22.622844    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"]
Sep 04 22:28:22.623318 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:22.623071    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" containerID="cri-o://12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90" gracePeriod=30
Sep 04 22:28:23.298813 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:23.298781    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:24.890235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:24.890196    2564 patch_prober.go:28] interesting pod/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:28:24.890623 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:24.890265    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:28:25.460922 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:25.460886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:28:27.897034 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.896962    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:28:27.936713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936678    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-certs\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.936900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936742    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-token\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.936900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936838    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-data\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.936900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936877    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khch7\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-kube-api-access-khch7\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.937061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936914    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-socket\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.937061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936948    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-envoy\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.937061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-podinfo\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.937061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936988    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:27.937061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.936999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-credential-socket\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.937061 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.937053    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b7af99-a653-4b1f-8165-6a1b6448b972-istiod-ca-cert\") pod \"58b7af99-a653-4b1f-8165-6a1b6448b972\" (UID: \"58b7af99-a653-4b1f-8165-6a1b6448b972\") "
Sep 04 22:28:27.937350 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.937220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:27.937396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.937347    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-data" (OuterVolumeSpecName: "istio-data") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:27.937452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.937413    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:27.938055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.937809    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b7af99-a653-4b1f-8165-6a1b6448b972-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:28:27.938055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.937966    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:27.938055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.937986    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:27.938055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.938001    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58b7af99-a653-4b1f-8165-6a1b6448b972-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:27.938055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.938013    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:27.938055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.938025    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:27.940218 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.940026    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:27.940218 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.940094    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:28:27.940218 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.940184    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-token" (OuterVolumeSpecName: "istio-token") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:27.941695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:27.941673    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-kube-api-access-khch7" (OuterVolumeSpecName: "kube-api-access-khch7") pod "58b7af99-a653-4b1f-8165-6a1b6448b972" (UID: "58b7af99-a653-4b1f-8165-6a1b6448b972"). InnerVolumeSpecName "kube-api-access-khch7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:28.038867 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.038825    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:28.038867 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.038867    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khch7\" (UniqueName: \"kubernetes.io/projected/58b7af99-a653-4b1f-8165-6a1b6448b972-kube-api-access-khch7\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:28.039066 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.038883    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:28.039066 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.038895    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58b7af99-a653-4b1f-8165-6a1b6448b972-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:28.499698 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.499652    2564 generic.go:356] "Generic (PLEG): container finished" podID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerID="12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90" exitCode=0
Sep 04 22:28:28.499855 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.499728    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"
Sep 04 22:28:28.499855 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.499729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" event={"ID":"58b7af99-a653-4b1f-8165-6a1b6448b972","Type":"ContainerDied","Data":"12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90"}
Sep 04 22:28:28.499940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.499854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx" event={"ID":"58b7af99-a653-4b1f-8165-6a1b6448b972","Type":"ContainerDied","Data":"14bb9ba72c01f8b098834d4e0654e90c3a70060373cdc5387ebf495aa48b3963"}
Sep 04 22:28:28.499940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.499876    2564 scope.go:117] "RemoveContainer" containerID="12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90"
Sep 04 22:28:28.509754 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.509731    2564 scope.go:117] "RemoveContainer" containerID="3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b"
Sep 04 22:28:28.519190 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.519171    2564 scope.go:117] "RemoveContainer" containerID="12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90"
Sep 04 22:28:28.519532 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:28.519509    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90\": container with ID starting with 12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90 not found: ID does not exist" containerID="12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90"
Sep 04 22:28:28.519584 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.519544    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90"} err="failed to get container status \"12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90\": rpc error: code = NotFound desc = could not find container \"12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90\": container with ID starting with 12825dd038b956721f2a337a0eb52e3683e7ec11d11cc7d948017da0b9998d90 not found: ID does not exist"
Sep 04 22:28:28.519584 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.519568    2564 scope.go:117] "RemoveContainer" containerID="3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b"
Sep 04 22:28:28.519906 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:28.519885    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b\": container with ID starting with 3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b not found: ID does not exist" containerID="3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b"
Sep 04 22:28:28.519997 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.519910    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b"} err="failed to get container status \"3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b\": rpc error: code = NotFound desc = could not find container \"3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b\": container with ID starting with 3da837a2f9dc22e8fdec9b04e6f73b8625bd16c90b2173030ff7bf06190c778b not found: ID does not exist"
Sep 04 22:28:28.529678 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.529655    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"]
Sep 04 22:28:28.534819 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.534796    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d9f7ae-openshift-default-7c4bcd9446-gjlvx"]
Sep 04 22:28:28.671464 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:28.671420    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" path="/var/lib/kubelet/pods/58b7af99-a653-4b1f-8165-6a1b6448b972/volumes"
Sep 04 22:28:30.514084 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:30.514004    2564 generic.go:356] "Generic (PLEG): container finished" podID="73378b07-5422-4af2-a780-b1048478ca2b" containerID="7398819c3c0061dd33f4214ada99ac854dd8277f1936514dcc9526a7edde4eb3" exitCode=0
Sep 04 22:28:30.514084 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:30.514043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" event={"ID":"73378b07-5422-4af2-a780-b1048478ca2b","Type":"ContainerDied","Data":"7398819c3c0061dd33f4214ada99ac854dd8277f1936514dcc9526a7edde4eb3"}
Sep 04 22:28:30.514516 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:30.514456    2564 scope.go:117] "RemoveContainer" containerID="7398819c3c0061dd33f4214ada99ac854dd8277f1936514dcc9526a7edde4eb3"
Sep 04 22:28:30.515503 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:30.515475    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:28:30.515561 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:30.515545    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:28:30.515620 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:30.515575    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:28:31.423351 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:31.423308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:31.524048 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:31.524013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" event={"ID":"73378b07-5422-4af2-a780-b1048478ca2b","Type":"ContainerStarted","Data":"48d87f2c9e1e87a9f8eead494fc43fedada265547fa871966028d1c241beaf52"}
Sep 04 22:28:31.786201 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:31.786108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:31.787424 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:31.787400    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:28:31.787548 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:31.787456    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 04 22:28:32.786325 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:32.786291    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:28:32.786798 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:32.786354    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 04 22:28:33.139342 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.139133    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t" podUID="f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" containerName="main" containerID="cri-o://c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802" gracePeriod=45
Sep 04 22:28:33.423196 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.423173    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:33.489496 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489458    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tls-certs\") pod \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") "
Sep 04 22:28:33.489707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489526    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-dshm\") pod \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") "
Sep 04 22:28:33.489707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-model-cache\") pod \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") "
Sep 04 22:28:33.489707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489682    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwbmq\" (UniqueName: \"kubernetes.io/projected/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-kube-api-access-pwbmq\") pod \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") "
Sep 04 22:28:33.489707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489706    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-home\") pod \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") "
Sep 04 22:28:33.489982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489807    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tmp-dir\") pod \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\" (UID: \"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556\") "
Sep 04 22:28:33.489982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489845    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" (UID: "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:33.489982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.489926    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-home" (OuterVolumeSpecName: "home") pod "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" (UID: "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:33.490121 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.490088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" (UID: "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:33.490228 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.490213    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-model-cache\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:33.490284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.490249    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-home\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:33.490284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.490262    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tmp-dir\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:33.491869 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.491846    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" (UID: "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:28:33.492024 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.492005    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-dshm" (OuterVolumeSpecName: "dshm") pod "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" (UID: "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:28:33.492074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.492020    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-kube-api-access-pwbmq" (OuterVolumeSpecName: "kube-api-access-pwbmq") pod "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" (UID: "f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556"). InnerVolumeSpecName "kube-api-access-pwbmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:28:33.544897 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.544849    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" containerID="c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802" exitCode=0
Sep 04 22:28:33.548621 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.545685    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"
Sep 04 22:28:33.552341 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.549752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t" event={"ID":"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556","Type":"ContainerDied","Data":"c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802"}
Sep 04 22:28:33.552341 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.549800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t" event={"ID":"f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556","Type":"ContainerDied","Data":"21fdca3aa7554613494614dddc70890fb7fa0d16026f657f922830f072201164"}
Sep 04 22:28:33.552341 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.549824    2564 scope.go:117] "RemoveContainer" containerID="c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802"
Sep 04 22:28:33.569907 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.569887    2564 scope.go:117] "RemoveContainer" containerID="c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802"
Sep 04 22:28:33.570218 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:33.570200    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802\": container with ID starting with c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802 not found: ID does not exist" containerID="c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802"
Sep 04 22:28:33.570270 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.570226    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802"} err="failed to get container status \"c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802\": rpc error: code = NotFound desc = could not find container \"c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802\": container with ID starting with c870e66f169ca7bb3b6e99a1d24d77ec8ebd08afbb5b63a4b9cfa7ad3d97d802 not found: ID does not exist"
Sep 04 22:28:33.584508 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.584484    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"]
Sep 04 22:28:33.588997 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.588975    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-e64d5c/noten-model-e64d5c-kserve-5f558595f-ll46t"]
Sep 04 22:28:33.591393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.591371    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-tls-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:33.591393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.591394    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-dshm\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:33.591521 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.591408    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwbmq\" (UniqueName: \"kubernetes.io/projected/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556-kube-api-access-pwbmq\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:28:33.786965 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.786875    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:28:33.786965 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:33.786948    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 04 22:28:34.676538 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:34.676505    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" path="/var/lib/kubelet/pods/f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556/volumes"
Sep 04 22:28:34.786211 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:34.786168    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:28:34.786496 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:34.786462    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 04 22:28:35.786551 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:35.786516    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 04 22:28:35.786966 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:35.786574    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 04 22:28:36.790110 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:36.790074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:36.790488 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:36.790352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:36.791069 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:36.791052    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:28:46.060120 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060085    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"]
Sep 04 22:28:46.060751 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060728    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" containerName="main"
Sep 04 22:28:46.060859 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060754    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" containerName="main"
Sep 04 22:28:46.060859 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060780    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy"
Sep 04 22:28:46.060859 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060789    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy"
Sep 04 22:28:46.060859 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060805    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy"
Sep 04 22:28:46.060859 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060813    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy"
Sep 04 22:28:46.061109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060942    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy"
Sep 04 22:28:46.061109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060955    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b7af99-a653-4b1f-8165-6a1b6448b972" containerName="istio-proxy"
Sep 04 22:28:46.061109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.060967    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3fbd99c-8f3d-4ffc-bc1b-d04684fb9556" containerName="main"
Sep 04 22:28:46.064159 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.064136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.066334 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.066314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-bc62f0-serving-cert\""
Sep 04 22:28:46.079805 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.079776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"]
Sep 04 22:28:46.112329 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.112295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.112494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.112428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxn2m\" (UniqueName: \"kubernetes.io/projected/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-kube-api-access-nxn2m\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.112494 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.112468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.112573 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.112499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.213573 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.213532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.213754 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.213688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxn2m\" (UniqueName: \"kubernetes.io/projected/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-kube-api-access-nxn2m\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.213754 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:46.213710    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-serving-cert: secret "maas-api-e2e-shared-a-w3-bc62f0-serving-cert" not found
Sep 04 22:28:46.213754 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.213724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.213894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.213764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.213894 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:28:46.213789    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls podName:f4c8fb07-d6f0-462e-a438-2ea2b9b05918 nodeName:}" failed. No retries permitted until 2026-09-04 22:28:46.713766223 +0000 UTC m=+1200.518123740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls") pod "maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc" (UID: "f4c8fb07-d6f0-462e-a438-2ea2b9b05918") : secret "maas-api-e2e-shared-a-w3-bc62f0-serving-cert" not found
Sep 04 22:28:46.214808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.214782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.216162 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.216143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.223028 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.223002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxn2m\" (UniqueName: \"kubernetes.io/projected/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-kube-api-access-nxn2m\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.719287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.719244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.721657 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.721631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:46.977024 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:46.976934    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:47.257264 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:47.257228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"]
Sep 04 22:28:47.258453 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:28:47.258421    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c8fb07_d6f0_462e_a438_2ea2b9b05918.slice/crio-f81bd7136ef6d12878ceb6ba1d63a1fd38b5cbd701e0dbb3b51f28e96c7044bb WatchSource:0}: Error finding container f81bd7136ef6d12878ceb6ba1d63a1fd38b5cbd701e0dbb3b51f28e96c7044bb: Status 404 returned error can't find the container with id f81bd7136ef6d12878ceb6ba1d63a1fd38b5cbd701e0dbb3b51f28e96c7044bb
Sep 04 22:28:47.628087 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:47.628048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc" event={"ID":"f4c8fb07-d6f0-462e-a438-2ea2b9b05918","Type":"ContainerStarted","Data":"f81bd7136ef6d12878ceb6ba1d63a1fd38b5cbd701e0dbb3b51f28e96c7044bb"}
Sep 04 22:28:48.636123 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:48.636085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc" event={"ID":"f4c8fb07-d6f0-462e-a438-2ea2b9b05918","Type":"ContainerStarted","Data":"309b8573d146f33843a57297c51ce8d12109774d6c2c44ddd802b8ed8766e461"}
Sep 04 22:28:48.636577 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:48.636168    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:28:48.686924 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:48.686875    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc" podStartSLOduration=2.260223564 podStartE2EDuration="2.686858336s" totalImagesPullingTime="426.634772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:28:48.684638361 +0000 UTC m=+1202.488995887" watchObservedRunningTime="2026-09-04 22:28:48.686858336 +0000 UTC m=+1202.491215861"
Sep 04 22:28:54.648139 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:28:54.648108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:29:10.676440 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.676409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"]
Sep 04 22:29:10.680454 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.680369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.683464 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.683441    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-bf86db-openshift-default-dockercfg-khbzq\""
Sep 04 22:29:10.694271 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.694243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"]
Sep 04 22:29:10.751235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-podinfo\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c682895-fbca-4505-8f94-92a3c2a750d8-istiod-ca-cert\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-credential-socket\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-data\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-certs\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-socket\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-token\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751780 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-kube-api-access-2l7zw\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.751780 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.751714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-envoy\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853223 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-data\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-certs\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-socket\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-token\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-kube-api-access-2l7zw\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-envoy\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853433 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-podinfo\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c682895-fbca-4505-8f94-92a3c2a750d8-istiod-ca-cert\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-credential-socket\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-data\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.853915 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-socket\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.854011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-certs\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.854011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.853945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-credential-socket\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.854293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.854273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c682895-fbca-4505-8f94-92a3c2a750d8-istiod-ca-cert\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.855839 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.855817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-envoy\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.856074 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.856055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-podinfo\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.863562 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.863530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-token\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.863680 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.863657    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-kube-api-access-2l7zw\") pod \"e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") " pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:10.991456 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:10.991369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:11.274158 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.274127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"]
Sep 04 22:29:11.275746 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:29:11.275714    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c682895_fbca_4505_8f94_92a3c2a750d8.slice/crio-eec5bef4a75b686babac6b93e3770ed3a4decee41c017f47953c61036fa7efd9 WatchSource:0}: Error finding container eec5bef4a75b686babac6b93e3770ed3a4decee41c017f47953c61036fa7efd9: Status 404 returned error can't find the container with id eec5bef4a75b686babac6b93e3770ed3a4decee41c017f47953c61036fa7efd9
Sep 04 22:29:11.277856 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.277823    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:29:11.277960 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.277889    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:29:11.277960 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.277923    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:29:11.759279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.759243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" event={"ID":"0c682895-fbca-4505-8f94-92a3c2a750d8","Type":"ContainerStarted","Data":"0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66"}
Sep 04 22:29:11.759684 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.759305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" event={"ID":"0c682895-fbca-4505-8f94-92a3c2a750d8","Type":"ContainerStarted","Data":"eec5bef4a75b686babac6b93e3770ed3a4decee41c017f47953c61036fa7efd9"}
Sep 04 22:29:11.782293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.782239    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" podStartSLOduration=1.782223901 podStartE2EDuration="1.782223901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:29:11.780294719 +0000 UTC m=+1225.584652254" watchObservedRunningTime="2026-09-04 22:29:11.782223901 +0000 UTC m=+1225.586581426"
Sep 04 22:29:11.992165 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:11.992123    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:12.997042 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:12.997005    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:13.770489 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:13.770451    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:13.771334 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:13.771308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:24.408412 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.408369    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"]
Sep 04 22:29:24.412366 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.412347    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.414568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.414550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3949cd16-serving-cert\""
Sep 04 22:29:24.424727 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.424705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"]
Sep 04 22:29:24.481300 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.481252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.481300 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.481306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c8e8c2-2bfc-4451-9f93-754847a43f33-openshift-service-ca\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.481541 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.481427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-metrics-certs\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.481541 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.481490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbp5l\" (UniqueName: \"kubernetes.io/projected/b6c8e8c2-2bfc-4451-9f93-754847a43f33-kube-api-access-nbp5l\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.582261 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.582222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.582457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.582269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c8e8c2-2bfc-4451-9f93-754847a43f33-openshift-service-ca\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.582457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.582335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-metrics-certs\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.582457 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:29:24.582380    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-serving-cert: secret "maas-api-e2e-mt-3949cd16-serving-cert" not found
Sep 04 22:29:24.582457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.582395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbp5l\" (UniqueName: \"kubernetes.io/projected/b6c8e8c2-2bfc-4451-9f93-754847a43f33-kube-api-access-nbp5l\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.582457 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:29:24.582452    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls podName:b6c8e8c2-2bfc-4451-9f93-754847a43f33 nodeName:}" failed. No retries permitted until 2026-09-04 22:29:25.08243573 +0000 UTC m=+1238.886793231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls") pod "maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv" (UID: "b6c8e8c2-2bfc-4451-9f93-754847a43f33") : secret "maas-api-e2e-mt-3949cd16-serving-cert" not found
Sep 04 22:29:24.583004 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.582980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c8e8c2-2bfc-4451-9f93-754847a43f33-openshift-service-ca\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.584811 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.584790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-metrics-certs\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:24.593117 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:24.593096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbp5l\" (UniqueName: \"kubernetes.io/projected/b6c8e8c2-2bfc-4451-9f93-754847a43f33-kube-api-access-nbp5l\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:25.087632 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:25.087577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:25.089955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:25.089927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls\") pod \"maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:25.322804 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:25.322774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:25.626417 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:25.626377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"]
Sep 04 22:29:25.628902 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:29:25.628876    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c8e8c2_2bfc_4451_9f93_754847a43f33.slice/crio-55b5db5983ea601365c7209f9c762dba4089580217cf6d3c99c00861a4689ba4 WatchSource:0}: Error finding container 55b5db5983ea601365c7209f9c762dba4089580217cf6d3c99c00861a4689ba4: Status 404 returned error can't find the container with id 55b5db5983ea601365c7209f9c762dba4089580217cf6d3c99c00861a4689ba4
Sep 04 22:29:25.834223 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:25.834124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv" event={"ID":"b6c8e8c2-2bfc-4451-9f93-754847a43f33","Type":"ContainerStarted","Data":"55b5db5983ea601365c7209f9c762dba4089580217cf6d3c99c00861a4689ba4"}
Sep 04 22:29:26.845619 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:26.845556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv" event={"ID":"b6c8e8c2-2bfc-4451-9f93-754847a43f33","Type":"ContainerStarted","Data":"714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab"}
Sep 04 22:29:26.846479 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:26.846451    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:26.864445 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:26.864387    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv" podStartSLOduration=2.286682406 podStartE2EDuration="2.864369149s" totalImagesPullingTime="577.686743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:29:26.862881291 +0000 UTC m=+1240.667238828" watchObservedRunningTime="2026-09-04 22:29:26.864369149 +0000 UTC m=+1240.668726673"
Sep 04 22:29:33.869486 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:33.869454    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:29:33.893153 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:33.893118    2564 generic.go:356] "Generic (PLEG): container finished" podID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerID="0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66" exitCode=0
Sep 04 22:29:33.893293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:33.893193    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" event={"ID":"0c682895-fbca-4505-8f94-92a3c2a750d8","Type":"ContainerDied","Data":"0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66"}
Sep 04 22:29:33.893566 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:33.893552    2564 scope.go:117] "RemoveContainer" containerID="0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66"
Sep 04 22:29:33.894638 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:33.894609    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:29:33.894750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:33.894685    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:29:33.894750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:33.894733    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:29:34.900512 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:34.900477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" event={"ID":"0c682895-fbca-4505-8f94-92a3c2a750d8","Type":"ContainerStarted","Data":"ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3"}
Sep 04 22:29:34.991522 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:34.991481    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:34.991844 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:34.991818    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 04 22:29:34.991953 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:34.991877    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 04 22:29:35.991709 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:35.991665    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 04 22:29:35.992098 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:35.991728    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 04 22:29:36.991950 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:36.991912    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 04 22:29:36.992347 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:36.991974    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 04 22:29:37.991809 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:37.991772    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 04 22:29:37.991977 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:37.991845    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 04 22:29:38.992385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:38.992298    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 04 22:29:38.992385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:38.992359    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 04 22:29:40.050932 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:40.050891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:40.051420 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:40.051397    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:29:40.052227 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:29:40.052209    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:30:12.704430 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.704396    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"]
Sep 04 22:30:12.709258 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.709241    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.711708 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.711677    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3949cd16\"/\"openshift-service-ca.crt\""
Sep 04 22:30:12.712287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.712266    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3949cd16\"/\"e2e-lifecycle-model-3949cd16-kserve-self-signed-certs\""
Sep 04 22:30:12.712343 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.712289    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3949cd16\"/\"default-dockercfg-458jc\""
Sep 04 22:30:12.712386 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.712262    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3949cd16\"/\"kube-root-ca.crt\""
Sep 04 22:30:12.717142 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.717121    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"]
Sep 04 22:30:12.763945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.763853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-model-cache\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.764268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.764245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-tmp-dir\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.764361 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.764318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb3254b-3288-4737-9d64-0586ea736fec-tls-certs\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.764426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.764373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-home\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.764488 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.764446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-dshm\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.764545 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.764527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2dvj\" (UniqueName: \"kubernetes.io/projected/bfb3254b-3288-4737-9d64-0586ea736fec-kube-api-access-l2dvj\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866157 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-model-cache\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-tmp-dir\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb3254b-3288-4737-9d64-0586ea736fec-tls-certs\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-home\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-dshm\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866348 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2dvj\" (UniqueName: \"kubernetes.io/projected/bfb3254b-3288-4737-9d64-0586ea736fec-kube-api-access-l2dvj\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866660 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-model-cache\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866736 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-tmp-dir\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.866736 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.866699    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-home\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.868543 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.868514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-dshm\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.868741 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.868725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb3254b-3288-4737-9d64-0586ea736fec-tls-certs\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:12.874429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:12.874410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2dvj\" (UniqueName: \"kubernetes.io/projected/bfb3254b-3288-4737-9d64-0586ea736fec-kube-api-access-l2dvj\") pod \"e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") " pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:13.020428 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:13.020333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:13.297317 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:13.297286    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"]
Sep 04 22:30:13.300037 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:30:13.300008    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfb3254b_3288_4737_9d64_0586ea736fec.slice/crio-00c286e01a4ebe0447812b1b1b629317278f4aa38ef813e48c891dcfe08570ea WatchSource:0}: Error finding container 00c286e01a4ebe0447812b1b1b629317278f4aa38ef813e48c891dcfe08570ea: Status 404 returned error can't find the container with id 00c286e01a4ebe0447812b1b1b629317278f4aa38ef813e48c891dcfe08570ea
Sep 04 22:30:14.118538 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:14.118493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk" event={"ID":"bfb3254b-3288-4737-9d64-0586ea736fec","Type":"ContainerStarted","Data":"57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867"}
Sep 04 22:30:14.118538 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:14.118544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk" event={"ID":"bfb3254b-3288-4737-9d64-0586ea736fec","Type":"ContainerStarted","Data":"00c286e01a4ebe0447812b1b1b629317278f4aa38ef813e48c891dcfe08570ea"}
Sep 04 22:30:14.137830 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:14.137773    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk" podStartSLOduration=2.1377556 podStartE2EDuration="2.1377556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:30:14.135205546 +0000 UTC m=+1287.939563072" watchObservedRunningTime="2026-09-04 22:30:14.1377556 +0000 UTC m=+1287.942113158"
Sep 04 22:30:23.021421 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:23.021374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:23.021851 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:23.021442    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:23.034013 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:23.033978    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:23.177717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:23.177682    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:30:53.965042 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:53.965003    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"]
Sep 04 22:30:53.965658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:53.965312    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv" podUID="b6c8e8c2-2bfc-4451-9f93-754847a43f33" containerName="maas-api" containerID="cri-o://714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab" gracePeriod=30
Sep 04 22:30:54.227504 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.227439    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:30:54.334024 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.333988    2564 generic.go:356] "Generic (PLEG): container finished" podID="b6c8e8c2-2bfc-4451-9f93-754847a43f33" containerID="714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab" exitCode=0
Sep 04 22:30:54.334217 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.334065    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"
Sep 04 22:30:54.334217 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.334082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv" event={"ID":"b6c8e8c2-2bfc-4451-9f93-754847a43f33","Type":"ContainerDied","Data":"714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab"}
Sep 04 22:30:54.334217 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.334178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv" event={"ID":"b6c8e8c2-2bfc-4451-9f93-754847a43f33","Type":"ContainerDied","Data":"55b5db5983ea601365c7209f9c762dba4089580217cf6d3c99c00861a4689ba4"}
Sep 04 22:30:54.334217 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.334202    2564 scope.go:117] "RemoveContainer" containerID="714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab"
Sep 04 22:30:54.346762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.346628    2564 scope.go:117] "RemoveContainer" containerID="714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab"
Sep 04 22:30:54.347358 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:30:54.347309    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab\": container with ID starting with 714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab not found: ID does not exist" containerID="714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab"
Sep 04 22:30:54.347504 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.347351    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab"} err="failed to get container status \"714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab\": rpc error: code = NotFound desc = could not find container \"714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab\": container with ID starting with 714709beefb7708a37e3426d6d3c3345c1e306d7ccccdf8a63bc953258eef8ab not found: ID does not exist"
Sep 04 22:30:54.372988 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.372938    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-metrics-certs\") pod \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") "
Sep 04 22:30:54.373254 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.373003    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c8e8c2-2bfc-4451-9f93-754847a43f33-openshift-service-ca\") pod \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") "
Sep 04 22:30:54.373254 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.373069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbp5l\" (UniqueName: \"kubernetes.io/projected/b6c8e8c2-2bfc-4451-9f93-754847a43f33-kube-api-access-nbp5l\") pod \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") "
Sep 04 22:30:54.373254 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.373195    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls\") pod \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\" (UID: \"b6c8e8c2-2bfc-4451-9f93-754847a43f33\") "
Sep 04 22:30:54.373777 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.373727    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6c8e8c2-2bfc-4451-9f93-754847a43f33-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6c8e8c2-2bfc-4451-9f93-754847a43f33" (UID: "b6c8e8c2-2bfc-4451-9f93-754847a43f33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:30:54.374169 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.374149    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6c8e8c2-2bfc-4451-9f93-754847a43f33-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:30:54.388485 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.388384    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b6c8e8c2-2bfc-4451-9f93-754847a43f33" (UID: "b6c8e8c2-2bfc-4451-9f93-754847a43f33"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:30:54.388638 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.388565    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6c8e8c2-2bfc-4451-9f93-754847a43f33" (UID: "b6c8e8c2-2bfc-4451-9f93-754847a43f33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:30:54.388932 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.388907    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c8e8c2-2bfc-4451-9f93-754847a43f33-kube-api-access-nbp5l" (OuterVolumeSpecName: "kube-api-access-nbp5l") pod "b6c8e8c2-2bfc-4451-9f93-754847a43f33" (UID: "b6c8e8c2-2bfc-4451-9f93-754847a43f33"). InnerVolumeSpecName "kube-api-access-nbp5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:30:54.475312 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.475278    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:30:54.475312 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.475308    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6c8e8c2-2bfc-4451-9f93-754847a43f33-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:30:54.475312 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.475317    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbp5l\" (UniqueName: \"kubernetes.io/projected/b6c8e8c2-2bfc-4451-9f93-754847a43f33-kube-api-access-nbp5l\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:30:54.659259 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.659229    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"]
Sep 04 22:30:54.663306 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.663282    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3949cd16-7c5cc87fbc-95jmv"]
Sep 04 22:30:54.672758 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:30:54.672731    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c8e8c2-2bfc-4451-9f93-754847a43f33" path="/var/lib/kubelet/pods/b6c8e8c2-2bfc-4451-9f93-754847a43f33/volumes"
Sep 04 22:31:02.712777 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:02.712740    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"]
Sep 04 22:31:17.733308 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:17.733214    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk" podUID="bfb3254b-3288-4737-9d64-0586ea736fec" containerName="main" containerID="cri-o://57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867" gracePeriod=45
Sep 04 22:31:17.990357 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:17.990299    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:31:18.114415 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114380    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-model-cache\") pod \"bfb3254b-3288-4737-9d64-0586ea736fec\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") "
Sep 04 22:31:18.114637 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb3254b-3288-4737-9d64-0586ea736fec-tls-certs\") pod \"bfb3254b-3288-4737-9d64-0586ea736fec\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") "
Sep 04 22:31:18.114637 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114467    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-home\") pod \"bfb3254b-3288-4737-9d64-0586ea736fec\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") "
Sep 04 22:31:18.114637 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2dvj\" (UniqueName: \"kubernetes.io/projected/bfb3254b-3288-4737-9d64-0586ea736fec-kube-api-access-l2dvj\") pod \"bfb3254b-3288-4737-9d64-0586ea736fec\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") "
Sep 04 22:31:18.114637 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-tmp-dir\") pod \"bfb3254b-3288-4737-9d64-0586ea736fec\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") "
Sep 04 22:31:18.114637 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114633    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-dshm\") pod \"bfb3254b-3288-4737-9d64-0586ea736fec\" (UID: \"bfb3254b-3288-4737-9d64-0586ea736fec\") "
Sep 04 22:31:18.114930 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114691    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfb3254b-3288-4737-9d64-0586ea736fec" (UID: "bfb3254b-3288-4737-9d64-0586ea736fec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:31:18.114930 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114799    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-home" (OuterVolumeSpecName: "home") pod "bfb3254b-3288-4737-9d64-0586ea736fec" (UID: "bfb3254b-3288-4737-9d64-0586ea736fec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:31:18.114930 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114878    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfb3254b-3288-4737-9d64-0586ea736fec" (UID: "bfb3254b-3288-4737-9d64-0586ea736fec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:31:18.115053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.114997    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-tmp-dir\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:31:18.115053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.115013    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-model-cache\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:31:18.115053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.115021    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-home\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:31:18.116816 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.116784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-dshm" (OuterVolumeSpecName: "dshm") pod "bfb3254b-3288-4737-9d64-0586ea736fec" (UID: "bfb3254b-3288-4737-9d64-0586ea736fec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:31:18.116918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.116828    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfb3254b-3288-4737-9d64-0586ea736fec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfb3254b-3288-4737-9d64-0586ea736fec" (UID: "bfb3254b-3288-4737-9d64-0586ea736fec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:31:18.116918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.116867    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb3254b-3288-4737-9d64-0586ea736fec-kube-api-access-l2dvj" (OuterVolumeSpecName: "kube-api-access-l2dvj") pod "bfb3254b-3288-4737-9d64-0586ea736fec" (UID: "bfb3254b-3288-4737-9d64-0586ea736fec"). InnerVolumeSpecName "kube-api-access-l2dvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:31:18.216065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.216021    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfb3254b-3288-4737-9d64-0586ea736fec-tls-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:31:18.216065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.216060    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2dvj\" (UniqueName: \"kubernetes.io/projected/bfb3254b-3288-4737-9d64-0586ea736fec-kube-api-access-l2dvj\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:31:18.216065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.216070    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfb3254b-3288-4737-9d64-0586ea736fec-dshm\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:31:18.472948 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.472913    2564 generic.go:356] "Generic (PLEG): container finished" podID="bfb3254b-3288-4737-9d64-0586ea736fec" containerID="57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867" exitCode=0
Sep 04 22:31:18.473157 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.472960    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"
Sep 04 22:31:18.473157 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.472993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk" event={"ID":"bfb3254b-3288-4737-9d64-0586ea736fec","Type":"ContainerDied","Data":"57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867"}
Sep 04 22:31:18.473157 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.473036    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk" event={"ID":"bfb3254b-3288-4737-9d64-0586ea736fec","Type":"ContainerDied","Data":"00c286e01a4ebe0447812b1b1b629317278f4aa38ef813e48c891dcfe08570ea"}
Sep 04 22:31:18.473157 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.473054    2564 scope.go:117] "RemoveContainer" containerID="57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867"
Sep 04 22:31:18.482709 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.482690    2564 scope.go:117] "RemoveContainer" containerID="57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867"
Sep 04 22:31:18.482971 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:31:18.482953    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867\": container with ID starting with 57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867 not found: ID does not exist" containerID="57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867"
Sep 04 22:31:18.483017 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.482980    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867"} err="failed to get container status \"57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867\": rpc error: code = NotFound desc = could not find container \"57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867\": container with ID starting with 57167bfe68681fc97261562457ca0885ab53d4406a624e28fbbfc210314cd867 not found: ID does not exist"
Sep 04 22:31:18.495175 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.495146    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"]
Sep 04 22:31:18.498993 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.498969    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3949cd16/e2e-lifecycle-model-3949cd16-kserve-db887756c-vf4wk"]
Sep 04 22:31:18.671946 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:31:18.671915    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfb3254b-3288-4737-9d64-0586ea736fec" path="/var/lib/kubelet/pods/bfb3254b-3288-4737-9d64-0586ea736fec/volumes"
Sep 04 22:32:40.342007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.341926    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7743-a2c9dd"]
Sep 04 22:32:40.342467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.342351    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c8e8c2-2bfc-4451-9f93-754847a43f33" containerName="maas-api"
Sep 04 22:32:40.342467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.342363    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c8e8c2-2bfc-4451-9f93-754847a43f33" containerName="maas-api"
Sep 04 22:32:40.342467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.342388    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfb3254b-3288-4737-9d64-0586ea736fec" containerName="main"
Sep 04 22:32:40.342467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.342393    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb3254b-3288-4737-9d64-0586ea736fec" containerName="main"
Sep 04 22:32:40.342467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.342460    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c8e8c2-2bfc-4451-9f93-754847a43f33" containerName="maas-api"
Sep 04 22:32:40.342467 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.342468    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfb3254b-3288-4737-9d64-0586ea736fec" containerName="main"
Sep 04 22:32:40.345738 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.345721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-a2c9dd"
Sep 04 22:32:40.347975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.347950    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dlrbm\""
Sep 04 22:32:40.354042 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.354014    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-a2c9dd"]
Sep 04 22:32:40.420846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.420809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj8rt\" (UniqueName: \"kubernetes.io/projected/6ce501a6-8c77-4596-86d6-3bda4210b6a7-kube-api-access-sj8rt\") pod \"mt-curl-7743-a2c9dd\" (UID: \"6ce501a6-8c77-4596-86d6-3bda4210b6a7\") " pod="opendatahub/mt-curl-7743-a2c9dd"
Sep 04 22:32:40.521580 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.521539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj8rt\" (UniqueName: \"kubernetes.io/projected/6ce501a6-8c77-4596-86d6-3bda4210b6a7-kube-api-access-sj8rt\") pod \"mt-curl-7743-a2c9dd\" (UID: \"6ce501a6-8c77-4596-86d6-3bda4210b6a7\") " pod="opendatahub/mt-curl-7743-a2c9dd"
Sep 04 22:32:40.531017 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.530986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj8rt\" (UniqueName: \"kubernetes.io/projected/6ce501a6-8c77-4596-86d6-3bda4210b6a7-kube-api-access-sj8rt\") pod \"mt-curl-7743-a2c9dd\" (UID: \"6ce501a6-8c77-4596-86d6-3bda4210b6a7\") " pod="opendatahub/mt-curl-7743-a2c9dd"
Sep 04 22:32:40.655851 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.655770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-a2c9dd"
Sep 04 22:32:40.930717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:40.930692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-a2c9dd"]
Sep 04 22:32:40.933317 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:32:40.933279    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ce501a6_8c77_4596_86d6_3bda4210b6a7.slice/crio-60735198bab8fb751460208f8458415a547015dd65079264094c1a4ef0bbcc42 WatchSource:0}: Error finding container 60735198bab8fb751460208f8458415a547015dd65079264094c1a4ef0bbcc42: Status 404 returned error can't find the container with id 60735198bab8fb751460208f8458415a547015dd65079264094c1a4ef0bbcc42
Sep 04 22:32:41.920086 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:41.920047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-a2c9dd" event={"ID":"6ce501a6-8c77-4596-86d6-3bda4210b6a7","Type":"ContainerStarted","Data":"60735198bab8fb751460208f8458415a547015dd65079264094c1a4ef0bbcc42"}
Sep 04 22:32:43.934218 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:43.934182    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-a2c9dd" event={"ID":"6ce501a6-8c77-4596-86d6-3bda4210b6a7","Type":"ContainerStarted","Data":"03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116"}
Sep 04 22:32:43.950853 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:43.950797    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/mt-curl-7743-a2c9dd" podStartSLOduration=1.759225765 podStartE2EDuration="3.950779743s" totalImagesPullingTime="2.191553978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:32:43.949665005 +0000 UTC m=+1437.754022528" watchObservedRunningTime="2026-09-04 22:32:43.950779743 +0000 UTC m=+1437.755137307"
Sep 04 22:32:44.576438 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:44.576396    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7743-a2c9dd"]
Sep 04 22:32:44.583340 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:44.583310    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7743-a2c9dd"]
Sep 04 22:32:44.939368 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:32:44.939330    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/mt-curl-7743-a2c9dd" container="mt-curl-7743-a2c9dd"
Sep 04 22:32:45.944449 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:45.944388    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/mt-curl-7743-a2c9dd" podUID="6ce501a6-8c77-4596-86d6-3bda4210b6a7" containerName="mt-curl-7743-a2c9dd" containerID="cri-o://03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116" gracePeriod=2
Sep 04 22:32:48.145910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.145882    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-a2c9dd"
Sep 04 22:32:48.300279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.300179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj8rt\" (UniqueName: \"kubernetes.io/projected/6ce501a6-8c77-4596-86d6-3bda4210b6a7-kube-api-access-sj8rt\") pod \"6ce501a6-8c77-4596-86d6-3bda4210b6a7\" (UID: \"6ce501a6-8c77-4596-86d6-3bda4210b6a7\") "
Sep 04 22:32:48.302385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.302356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce501a6-8c77-4596-86d6-3bda4210b6a7-kube-api-access-sj8rt" (OuterVolumeSpecName: "kube-api-access-sj8rt") pod "6ce501a6-8c77-4596-86d6-3bda4210b6a7" (UID: "6ce501a6-8c77-4596-86d6-3bda4210b6a7"). InnerVolumeSpecName "kube-api-access-sj8rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:32:48.401197 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.401154    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj8rt\" (UniqueName: \"kubernetes.io/projected/6ce501a6-8c77-4596-86d6-3bda4210b6a7-kube-api-access-sj8rt\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:32:48.671715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.671672    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce501a6-8c77-4596-86d6-3bda4210b6a7" path="/var/lib/kubelet/pods/6ce501a6-8c77-4596-86d6-3bda4210b6a7/volumes"
Sep 04 22:32:48.968581 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.968472    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ce501a6-8c77-4596-86d6-3bda4210b6a7" containerID="03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116" exitCode=137
Sep 04 22:32:48.968581 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.968532    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-a2c9dd"
Sep 04 22:32:48.968581 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.968566    2564 scope.go:117] "RemoveContainer" containerID="03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116"
Sep 04 22:32:48.977464 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.977446    2564 scope.go:117] "RemoveContainer" containerID="03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116"
Sep 04 22:32:48.977769 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:32:48.977750    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116\": container with ID starting with 03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116 not found: ID does not exist" containerID="03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116"
Sep 04 22:32:48.977834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:48.977776    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116"} err="failed to get container status \"03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116\": rpc error: code = NotFound desc = could not find container \"03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116\": container with ID starting with 03851db9a192df703de674ba2d96a1ee6cca981445cd07e9683596d629e33116 not found: ID does not exist"
Sep 04 22:32:51.606100 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.606060    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"]
Sep 04 22:32:51.606771 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.606749    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce501a6-8c77-4596-86d6-3bda4210b6a7" containerName="mt-curl-7743-a2c9dd"
Sep 04 22:32:51.606843 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.606776    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce501a6-8c77-4596-86d6-3bda4210b6a7" containerName="mt-curl-7743-a2c9dd"
Sep 04 22:32:51.606900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.606889    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce501a6-8c77-4596-86d6-3bda4210b6a7" containerName="mt-curl-7743-a2c9dd"
Sep 04 22:32:51.611535 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.611514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.614892 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.614868    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-bc62f0\"/\"sub-test-model-bc62f0-kserve-self-signed-certs\""
Sep 04 22:32:51.614892 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.614888    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-bc62f0\"/\"openshift-service-ca.crt\""
Sep 04 22:32:51.615063 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.614864    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-bc62f0\"/\"default-dockercfg-7pmj4\""
Sep 04 22:32:51.615063 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.614916    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-bc62f0\"/\"kube-root-ca.crt\""
Sep 04 22:32:51.618794 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.618768    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"]
Sep 04 22:32:51.738052 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.738006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b59bb-a65b-453d-a850-80d9c94fd340-tls-certs\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.738247 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.738123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-home\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.738247 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.738159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-dshm\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.738370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.738261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-model-cache\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.738370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.738281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-tmp-dir\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.738370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.738334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7tx\" (UniqueName: \"kubernetes.io/projected/c88b59bb-a65b-453d-a850-80d9c94fd340-kube-api-access-nr7tx\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839428 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-model-cache\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839428 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-tmp-dir\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7tx\" (UniqueName: \"kubernetes.io/projected/c88b59bb-a65b-453d-a850-80d9c94fd340-kube-api-access-nr7tx\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b59bb-a65b-453d-a850-80d9c94fd340-tls-certs\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839704 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-home\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839880 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-dshm\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839880 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-tmp-dir\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.839880 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.839873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-model-cache\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.840062 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.840026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-home\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.842088 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.842063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-dshm\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.842288 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.842273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b59bb-a65b-453d-a850-80d9c94fd340-tls-certs\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.849500 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.849468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7tx\" (UniqueName: \"kubernetes.io/projected/c88b59bb-a65b-453d-a850-80d9c94fd340-kube-api-access-nr7tx\") pod \"sub-test-model-bc62f0-kserve-596468d585-vfndw\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") " pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:51.922245 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:51.922150    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:32:52.199843 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:52.199762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"]
Sep 04 22:32:52.203529 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:32:52.203476    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc88b59bb_a65b_453d_a850_80d9c94fd340.slice/crio-30fd832be553cea24f148b0604f80e8024c94e5e8dab2358a2daa1379d532d3d WatchSource:0}: Error finding container 30fd832be553cea24f148b0604f80e8024c94e5e8dab2358a2daa1379d532d3d: Status 404 returned error can't find the container with id 30fd832be553cea24f148b0604f80e8024c94e5e8dab2358a2daa1379d532d3d
Sep 04 22:32:52.995479 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:52.995445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw" event={"ID":"c88b59bb-a65b-453d-a850-80d9c94fd340","Type":"ContainerStarted","Data":"7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c"}
Sep 04 22:32:52.995920 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:52.995505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw" event={"ID":"c88b59bb-a65b-453d-a850-80d9c94fd340","Type":"ContainerStarted","Data":"30fd832be553cea24f148b0604f80e8024c94e5e8dab2358a2daa1379d532d3d"}
Sep 04 22:32:53.015529 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:53.015476    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw" podStartSLOduration=2.015458391 podStartE2EDuration="2.015458391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:32:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:32:53.014156487 +0000 UTC m=+1446.818514017" watchObservedRunningTime="2026-09-04 22:32:53.015458391 +0000 UTC m=+1446.819815945"
Sep 04 22:32:58.386226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.386192    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"]
Sep 04 22:32:58.389916 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.389899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.392540 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.392520    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b852ba-openshift-default-dockercfg-gxvps\""
Sep 04 22:32:58.406928 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.406900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"]
Sep 04 22:32:58.503778 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.503741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-envoy\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.503960 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.503933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-token\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.504058 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.504015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-credential-socket\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.504058 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.504043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-data\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.504210 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.504185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-podinfo\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.504269 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.504258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-socket\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.504349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.504327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-certs\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.504382 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.504361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gcgc\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-kube-api-access-6gcgc\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.504429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.504416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istiod-ca-cert\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605378 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istiod-ca-cert\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605552 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-envoy\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605552 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-token\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605552 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-credential-socket\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605552 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-data\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605811 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-podinfo\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605811 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-socket\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605811 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-certs\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.605811 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gcgc\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-kube-api-access-6gcgc\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.606007 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.605926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-credential-socket\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.606050 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.606019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-socket\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.606086 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.606069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-certs\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.606243 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.606222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istiod-ca-cert\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.606331 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.606307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-data\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.607762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.607738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-envoy\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.608057 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.608040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-podinfo\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.620567 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.620544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-token\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.624318 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.624291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gcgc\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-kube-api-access-6gcgc\") pod \"e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") " pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.700555 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.700473    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:32:58.987713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.987524    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"]
Sep 04 22:32:58.988234 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:32:58.988190    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed4887c_2a18_45c0_89c3_6a077c7e8e22.slice/crio-424ed32abb6c218d39452649f6d96a4ff6316ca37a55816d90d156e177584e6b WatchSource:0}: Error finding container 424ed32abb6c218d39452649f6d96a4ff6316ca37a55816d90d156e177584e6b: Status 404 returned error can't find the container with id 424ed32abb6c218d39452649f6d96a4ff6316ca37a55816d90d156e177584e6b
Sep 04 22:32:58.991172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.991137    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:32:58.991259 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.991205    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:32:58.991259 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:58.991233    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:32:59.029099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:32:59.029073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" event={"ID":"1ed4887c-2a18-45c0-89c3-6a077c7e8e22","Type":"ContainerStarted","Data":"424ed32abb6c218d39452649f6d96a4ff6316ca37a55816d90d156e177584e6b"}
Sep 04 22:33:00.036946 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:00.036903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" event={"ID":"1ed4887c-2a18-45c0-89c3-6a077c7e8e22","Type":"ContainerStarted","Data":"1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4"}
Sep 04 22:33:00.064896 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:00.064835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" podStartSLOduration=2.064818953 podStartE2EDuration="2.064818953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:33:00.062400569 +0000 UTC m=+1453.866758094" watchObservedRunningTime="2026-09-04 22:33:00.064818953 +0000 UTC m=+1453.869176547"
Sep 04 22:33:00.701672 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:00.701639    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:00.707328 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:00.707303    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:01.042735 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:01.042649    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:01.043731 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:01.043710    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:01.922325 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:01.922285    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:33:01.922515 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:01.922349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:33:01.935482 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:01.935448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:33:02.059445 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:02.059414    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:33:24.180834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:24.180798    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerID="1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4" exitCode=0
Sep 04 22:33:24.181260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:24.180871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" event={"ID":"1ed4887c-2a18-45c0-89c3-6a077c7e8e22","Type":"ContainerDied","Data":"1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4"}
Sep 04 22:33:24.181376 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:24.181357    2564 scope.go:117] "RemoveContainer" containerID="1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4"
Sep 04 22:33:24.182536 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:24.182507    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:24.182624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:24.182579    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:24.182673 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:24.182626    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:25.188740 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:25.188700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" event={"ID":"1ed4887c-2a18-45c0-89c3-6a077c7e8e22","Type":"ContainerStarted","Data":"b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143"}
Sep 04 22:33:25.700916 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:25.700881    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:25.701126 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:25.701094    2564 patch_prober.go:28] interesting pod/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 04 22:33:25.701206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:25.701150    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 04 22:33:26.701008 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:26.700970    2564 patch_prober.go:28] interesting pod/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 04 22:33:26.701469 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:26.701027    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 04 22:33:27.701646 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:27.701589    2564 patch_prober.go:28] interesting pod/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 04 22:33:27.702041 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:27.701664    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 04 22:33:27.961049 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:27.960952    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"]
Sep 04 22:33:27.964368 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:27.964343    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:27.967173 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:27.967152    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ef263a-openshift-default-dockercfg-rqqm2\""
Sep 04 22:33:27.989993 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:27.987797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"]
Sep 04 22:33:28.102553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-credential-socket\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-podinfo\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-envoy\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr8kp\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-kube-api-access-qr8kp\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-certs\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-socket\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-token\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102962 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istiod-ca-cert\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.102962 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.102782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-data\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-envoy\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203397 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr8kp\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-kube-api-access-qr8kp\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-certs\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-socket\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-token\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istiod-ca-cert\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-data\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-credential-socket\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.203700 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-podinfo\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.204109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.203998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-certs\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.204109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.204058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-socket\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.204206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.204129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-data\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.204332 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.204301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-credential-socket\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.204987 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.204956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istiod-ca-cert\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.206126 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.206095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-envoy\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.206226 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.206180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-podinfo\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.214147 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.214077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-token\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.214372 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.214348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr8kp\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-kube-api-access-qr8kp\") pod \"e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") " pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.281374 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.281345    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:28.566900 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.566817    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"]
Sep 04 22:33:28.569529 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:33:28.569500    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775a4b9d_ef08_4e3e_b706_5e095b61e9c0.slice/crio-4591ab1776d5783211487aacd2a0ded4183c25880a1ebf5b617971741fe626f1 WatchSource:0}: Error finding container 4591ab1776d5783211487aacd2a0ded4183c25880a1ebf5b617971741fe626f1: Status 404 returned error can't find the container with id 4591ab1776d5783211487aacd2a0ded4183c25880a1ebf5b617971741fe626f1
Sep 04 22:33:28.572412 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.572376    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:28.572499 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.572448    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:28.572499 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.572476    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:28.701385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.701347    2564 patch_prober.go:28] interesting pod/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 04 22:33:28.701576 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:28.701413    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 04 22:33:29.214451 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:29.214410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" event={"ID":"775a4b9d-ef08-4e3e-b706-5e095b61e9c0","Type":"ContainerStarted","Data":"3aba4724380e9b98c0505fdc887e0df0d3e8d2485fd47c8a434b4252a50a2079"}
Sep 04 22:33:29.214834 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:29.214480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" event={"ID":"775a4b9d-ef08-4e3e-b706-5e095b61e9c0","Type":"ContainerStarted","Data":"4591ab1776d5783211487aacd2a0ded4183c25880a1ebf5b617971741fe626f1"}
Sep 04 22:33:29.235642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:29.235537    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podStartSLOduration=2.235516725 podStartE2EDuration="2.235516725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:33:29.234585677 +0000 UTC m=+1483.038943202" watchObservedRunningTime="2026-09-04 22:33:29.235516725 +0000 UTC m=+1483.039874250"
Sep 04 22:33:29.282054 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:29.282025    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:29.287547 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:29.287524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:29.701269 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:29.701233    2564 patch_prober.go:28] interesting pod/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 04 22:33:29.701417 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:29.701301    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 04 22:33:30.220329 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:30.220294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:30.221359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:30.221339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:30.704460 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:30.704431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:30.704727 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:30.704709    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:30.705478 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:30.705457    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:33:32.522784 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.522749    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"]
Sep 04 22:33:32.528056 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.528029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.530484 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.530459    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ef263a-serving-cert\""
Sep 04 22:33:32.541686 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.541663    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"]
Sep 04 22:33:32.653279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.653240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3315f175-b667-4144-8d5d-902219a2805b-openshift-service-ca\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.653573 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.653551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lcgf\" (UniqueName: \"kubernetes.io/projected/3315f175-b667-4144-8d5d-902219a2805b-kube-api-access-9lcgf\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.653838 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.653820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-metrics-certs\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.654082 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.654052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.755453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.755417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lcgf\" (UniqueName: \"kubernetes.io/projected/3315f175-b667-4144-8d5d-902219a2805b-kube-api-access-9lcgf\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.755658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.755509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-metrics-certs\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.755658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.755543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.755658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.755579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3315f175-b667-4144-8d5d-902219a2805b-openshift-service-ca\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.755806 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:33:32.755704    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-serving-cert: secret "maas-api-e2e-api-b-ef263a-serving-cert" not found
Sep 04 22:33:32.755806 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:33:32.755767    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls podName:3315f175-b667-4144-8d5d-902219a2805b nodeName:}" failed. No retries permitted until 2026-09-04 22:33:33.255752024 +0000 UTC m=+1487.060109527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls") pod "maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d" (UID: "3315f175-b667-4144-8d5d-902219a2805b") : secret "maas-api-e2e-api-b-ef263a-serving-cert" not found
Sep 04 22:33:32.756265 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.756237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3315f175-b667-4144-8d5d-902219a2805b-openshift-service-ca\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.757934 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.757913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-metrics-certs\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:32.779613 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:32.779537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lcgf\" (UniqueName: \"kubernetes.io/projected/3315f175-b667-4144-8d5d-902219a2805b-kube-api-access-9lcgf\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:33.261060 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:33.261026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:33.263428 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:33.263402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls\") pod \"maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:33.440613 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:33.440572    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:33.729385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:33.729362    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"]
Sep 04 22:33:33.731561 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:33:33.731534    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3315f175_b667_4144_8d5d_902219a2805b.slice/crio-b7848a46cdf8d343499985cec2bd92e8935a0051c609e05117924d12c0877026 WatchSource:0}: Error finding container b7848a46cdf8d343499985cec2bd92e8935a0051c609e05117924d12c0877026: Status 404 returned error can't find the container with id b7848a46cdf8d343499985cec2bd92e8935a0051c609e05117924d12c0877026
Sep 04 22:33:33.732955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:33.732926    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:33:34.243974 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:34.243940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d" event={"ID":"3315f175-b667-4144-8d5d-902219a2805b","Type":"ContainerStarted","Data":"b7848a46cdf8d343499985cec2bd92e8935a0051c609e05117924d12c0877026"}
Sep 04 22:33:35.251488 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:35.251444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d" event={"ID":"3315f175-b667-4144-8d5d-902219a2805b","Type":"ContainerStarted","Data":"8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373"}
Sep 04 22:33:35.251955 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:35.251524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:35.272931 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:35.272875    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d" podStartSLOduration=2.631855715 podStartE2EDuration="3.27285767s" totalImagesPullingTime="641.001955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:33:35.270558018 +0000 UTC m=+1489.074915541" watchObservedRunningTime="2026-09-04 22:33:35.27285767 +0000 UTC m=+1489.077215226"
Sep 04 22:33:41.265126 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:41.265090    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:33:46.262780 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:46.262729    2564 patch_prober.go:28] interesting pod/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:33:46.263261 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:46.262799    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:33:48.328476 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:48.328439    2564 generic.go:356] "Generic (PLEG): container finished" podID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerID="3aba4724380e9b98c0505fdc887e0df0d3e8d2485fd47c8a434b4252a50a2079" exitCode=0
Sep 04 22:33:48.328894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:48.328516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" event={"ID":"775a4b9d-ef08-4e3e-b706-5e095b61e9c0","Type":"ContainerDied","Data":"3aba4724380e9b98c0505fdc887e0df0d3e8d2485fd47c8a434b4252a50a2079"}
Sep 04 22:33:48.328946 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:48.328932    2564 scope.go:117] "RemoveContainer" containerID="3aba4724380e9b98c0505fdc887e0df0d3e8d2485fd47c8a434b4252a50a2079"
Sep 04 22:33:48.330055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:48.330028    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:48.330102 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:48.330094    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:48.330140 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:48.330123    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:33:49.336618 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:49.336559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" event={"ID":"775a4b9d-ef08-4e3e-b706-5e095b61e9c0","Type":"ContainerStarted","Data":"c01058fce4646d8770a34256e928e96ab6fe298cbc9a1de3620d5f01889574df"}
Sep 04 22:33:50.281563 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:50.281518    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:50.281886 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:50.281861    2564 patch_prober.go:28] interesting pod/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 04 22:33:50.281983 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:50.281917    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 04 22:33:51.282372 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:51.282341    2564 patch_prober.go:28] interesting pod/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 04 22:33:51.282764 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:51.282410    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 04 22:33:52.281884 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:52.281845    2564 patch_prober.go:28] interesting pod/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 04 22:33:52.282062 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:52.281903    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 04 22:33:53.282025 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:53.281829    2564 patch_prober.go:28] interesting pod/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 04 22:33:53.282531 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:53.282045    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 04 22:33:54.282427 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:54.282391    2564 patch_prober.go:28] interesting pod/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 04 22:33:54.282857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:54.282449    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 04 22:33:55.285712 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:55.285680    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:55.286172 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:55.286098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:33:55.286794 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:33:55.286772    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:34:16.304146 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:16.304074    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"]
Sep 04 22:34:31.192185 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.192144    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"]
Sep 04 22:34:31.192678 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.192497    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy" containerID="cri-o://b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143" gracePeriod=30
Sep 04 22:34:31.323582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.323544    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw" podUID="c88b59bb-a65b-453d-a850-80d9c94fd340" containerName="main" containerID="cri-o://7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c" gracePeriod=45
Sep 04 22:34:31.577811 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.577780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:34:31.584075 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.584044    2564 generic.go:356] "Generic (PLEG): container finished" podID="c88b59bb-a65b-453d-a850-80d9c94fd340" containerID="7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c" exitCode=0
Sep 04 22:34:31.584075 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.584075    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"
Sep 04 22:34:31.584291 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.584120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw" event={"ID":"c88b59bb-a65b-453d-a850-80d9c94fd340","Type":"ContainerDied","Data":"7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c"}
Sep 04 22:34:31.584291 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.584166    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw" event={"ID":"c88b59bb-a65b-453d-a850-80d9c94fd340","Type":"ContainerDied","Data":"30fd832be553cea24f148b0604f80e8024c94e5e8dab2358a2daa1379d532d3d"}
Sep 04 22:34:31.584291 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.584191    2564 scope.go:117] "RemoveContainer" containerID="7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c"
Sep 04 22:34:31.594881 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.594858    2564 scope.go:117] "RemoveContainer" containerID="7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c"
Sep 04 22:34:31.595188 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:34:31.595170    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c\": container with ID starting with 7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c not found: ID does not exist" containerID="7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c"
Sep 04 22:34:31.595257 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.595196    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c"} err="failed to get container status \"7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c\": rpc error: code = NotFound desc = could not find container \"7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c\": container with ID starting with 7f753ac9efe08963390f3f8be0711f19660c57c6ead3ebfc28efa56bfa82269c not found: ID does not exist"
Sep 04 22:34:31.672717 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.672681    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-tmp-dir\") pod \"c88b59bb-a65b-453d-a850-80d9c94fd340\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") "
Sep 04 22:34:31.672885 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.672733    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b59bb-a65b-453d-a850-80d9c94fd340-tls-certs\") pod \"c88b59bb-a65b-453d-a850-80d9c94fd340\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") "
Sep 04 22:34:31.672885 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.672756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-home\") pod \"c88b59bb-a65b-453d-a850-80d9c94fd340\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") "
Sep 04 22:34:31.672885 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.672775    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr7tx\" (UniqueName: \"kubernetes.io/projected/c88b59bb-a65b-453d-a850-80d9c94fd340-kube-api-access-nr7tx\") pod \"c88b59bb-a65b-453d-a850-80d9c94fd340\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") "
Sep 04 22:34:31.672885 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.672873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-dshm\") pod \"c88b59bb-a65b-453d-a850-80d9c94fd340\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") "
Sep 04 22:34:31.673106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.672890    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-model-cache\") pod \"c88b59bb-a65b-453d-a850-80d9c94fd340\" (UID: \"c88b59bb-a65b-453d-a850-80d9c94fd340\") "
Sep 04 22:34:31.673106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.672992    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c88b59bb-a65b-453d-a850-80d9c94fd340" (UID: "c88b59bb-a65b-453d-a850-80d9c94fd340"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:31.673106 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.673004    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-home" (OuterVolumeSpecName: "home") pod "c88b59bb-a65b-453d-a850-80d9c94fd340" (UID: "c88b59bb-a65b-453d-a850-80d9c94fd340"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:31.673259 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.673216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-model-cache" (OuterVolumeSpecName: "model-cache") pod "c88b59bb-a65b-453d-a850-80d9c94fd340" (UID: "c88b59bb-a65b-453d-a850-80d9c94fd340"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:31.673321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.673262    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-tmp-dir\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:31.673321 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.673287    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-home\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:31.675047 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.675021    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88b59bb-a65b-453d-a850-80d9c94fd340-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c88b59bb-a65b-453d-a850-80d9c94fd340" (UID: "c88b59bb-a65b-453d-a850-80d9c94fd340"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:34:31.675159 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.675036    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-dshm" (OuterVolumeSpecName: "dshm") pod "c88b59bb-a65b-453d-a850-80d9c94fd340" (UID: "c88b59bb-a65b-453d-a850-80d9c94fd340"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:31.675159 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.675117    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c88b59bb-a65b-453d-a850-80d9c94fd340-kube-api-access-nr7tx" (OuterVolumeSpecName: "kube-api-access-nr7tx") pod "c88b59bb-a65b-453d-a850-80d9c94fd340" (UID: "c88b59bb-a65b-453d-a850-80d9c94fd340"). InnerVolumeSpecName "kube-api-access-nr7tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:34:31.775002 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.774907    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b59bb-a65b-453d-a850-80d9c94fd340-tls-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:31.775002 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.774944    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr7tx\" (UniqueName: \"kubernetes.io/projected/c88b59bb-a65b-453d-a850-80d9c94fd340-kube-api-access-nr7tx\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:31.775002 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.774959    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-dshm\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:31.775002 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.774975    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c88b59bb-a65b-453d-a850-80d9c94fd340-model-cache\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:31.914699 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.914664    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"]
Sep 04 22:34:31.925757 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:31.925723    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-bc62f0/sub-test-model-bc62f0-kserve-596468d585-vfndw"]
Sep 04 22:34:32.673950 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:32.673911    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c88b59bb-a65b-453d-a850-80d9c94fd340" path="/var/lib/kubelet/pods/c88b59bb-a65b-453d-a850-80d9c94fd340/volumes"
Sep 04 22:34:36.467805 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.467734    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:34:36.624336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624302    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerID="b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143" exitCode=0
Sep 04 22:34:36.624506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624359    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"
Sep 04 22:34:36.624506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" event={"ID":"1ed4887c-2a18-45c0-89c3-6a077c7e8e22","Type":"ContainerDied","Data":"b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143"}
Sep 04 22:34:36.624506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624444    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-data\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.624506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624463    2564 scope.go:117] "RemoveContainer" containerID="b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143"
Sep 04 22:34:36.624506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624476    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-credential-socket\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.624506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t" event={"ID":"1ed4887c-2a18-45c0-89c3-6a077c7e8e22","Type":"ContainerDied","Data":"424ed32abb6c218d39452649f6d96a4ff6316ca37a55816d90d156e177584e6b"}
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624526    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-socket\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istiod-ca-cert\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-certs\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-envoy\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624817    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624830    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-podinfo\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624861    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:36.624945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624891    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gcgc\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-kube-api-access-6gcgc\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.624954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-token\") pod \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\" (UID: \"1ed4887c-2a18-45c0-89c3-6a077c7e8e22\") "
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.625017    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.625082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.625339    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.625363    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.625378    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.625392    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.625406 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.625402    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.627214 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.627185    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:34:36.627332 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.627245    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-kube-api-access-6gcgc" (OuterVolumeSpecName: "kube-api-access-6gcgc") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "kube-api-access-6gcgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:34:36.627413 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.627341    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:34:36.627413 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.627341    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ed4887c-2a18-45c0-89c3-6a077c7e8e22" (UID: "1ed4887c-2a18-45c0-89c3-6a077c7e8e22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:34:36.650026 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.649992    2564 scope.go:117] "RemoveContainer" containerID="1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4"
Sep 04 22:34:36.658917 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.658897    2564 scope.go:117] "RemoveContainer" containerID="b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143"
Sep 04 22:34:36.659187 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:34:36.659168    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143\": container with ID starting with b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143 not found: ID does not exist" containerID="b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143"
Sep 04 22:34:36.659239 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.659200    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143"} err="failed to get container status \"b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143\": rpc error: code = NotFound desc = could not find container \"b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143\": container with ID starting with b4079e4917d5a5c7518b173e3aa54f35200aa57be6663f540c634d6b4e3d0143 not found: ID does not exist"
Sep 04 22:34:36.659239 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.659217    2564 scope.go:117] "RemoveContainer" containerID="1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4"
Sep 04 22:34:36.659486 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:34:36.659468    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4\": container with ID starting with 1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4 not found: ID does not exist" containerID="1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4"
Sep 04 22:34:36.659537 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.659494    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4"} err="failed to get container status \"1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4\": rpc error: code = NotFound desc = could not find container \"1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4\": container with ID starting with 1c0da3a95c8dae9170f77134dc6c90b538995ce36e8bee31dbb3d5f00dfc3ea4 not found: ID does not exist"
Sep 04 22:34:36.726864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.726786    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.726864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.726813    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.726864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.726822    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gcgc\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-kube-api-access-6gcgc\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.726864 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.726833    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ed4887c-2a18-45c0-89c3-6a077c7e8e22-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:36.944539 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.944506    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"]
Sep 04 22:34:36.950965 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:36.950937    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b852ba-openshift-default-854864fd8d-xhl5t"]
Sep 04 22:34:38.672048 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:38.672010    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" path="/var/lib/kubelet/pods/1ed4887c-2a18-45c0-89c3-6a077c7e8e22/volumes"
Sep 04 22:34:48.241894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.241852    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"]
Sep 04 22:34:48.242357 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.242125    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d" podUID="3315f175-b667-4144-8d5d-902219a2805b" containerName="maas-api" containerID="cri-o://8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373" gracePeriod=30
Sep 04 22:34:48.500253 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.500191    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:34:48.538134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.538105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-metrics-certs\") pod \"3315f175-b667-4144-8d5d-902219a2805b\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") "
Sep 04 22:34:48.538305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.538150    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3315f175-b667-4144-8d5d-902219a2805b-openshift-service-ca\") pod \"3315f175-b667-4144-8d5d-902219a2805b\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") "
Sep 04 22:34:48.538305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.538188    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls\") pod \"3315f175-b667-4144-8d5d-902219a2805b\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") "
Sep 04 22:34:48.538305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.538251    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lcgf\" (UniqueName: \"kubernetes.io/projected/3315f175-b667-4144-8d5d-902219a2805b-kube-api-access-9lcgf\") pod \"3315f175-b667-4144-8d5d-902219a2805b\" (UID: \"3315f175-b667-4144-8d5d-902219a2805b\") "
Sep 04 22:34:48.538640 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.538587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3315f175-b667-4144-8d5d-902219a2805b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3315f175-b667-4144-8d5d-902219a2805b" (UID: "3315f175-b667-4144-8d5d-902219a2805b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:34:48.540593 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.540566    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3315f175-b667-4144-8d5d-902219a2805b" (UID: "3315f175-b667-4144-8d5d-902219a2805b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:34:48.540755 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.540644    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3315f175-b667-4144-8d5d-902219a2805b-kube-api-access-9lcgf" (OuterVolumeSpecName: "kube-api-access-9lcgf") pod "3315f175-b667-4144-8d5d-902219a2805b" (UID: "3315f175-b667-4144-8d5d-902219a2805b"). InnerVolumeSpecName "kube-api-access-9lcgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:34:48.540832 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.540780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3315f175-b667-4144-8d5d-902219a2805b" (UID: "3315f175-b667-4144-8d5d-902219a2805b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:34:48.639356 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.639324    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:48.639356 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.639351    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3315f175-b667-4144-8d5d-902219a2805b-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:48.639356 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.639360    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3315f175-b667-4144-8d5d-902219a2805b-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:48.639595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.639369    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lcgf\" (UniqueName: \"kubernetes.io/projected/3315f175-b667-4144-8d5d-902219a2805b-kube-api-access-9lcgf\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:34:48.697386 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.697346    2564 generic.go:356] "Generic (PLEG): container finished" podID="3315f175-b667-4144-8d5d-902219a2805b" containerID="8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373" exitCode=0
Sep 04 22:34:48.697641 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.697413    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"
Sep 04 22:34:48.698263 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.697449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d" event={"ID":"3315f175-b667-4144-8d5d-902219a2805b","Type":"ContainerDied","Data":"8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373"}
Sep 04 22:34:48.698263 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.697833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d" event={"ID":"3315f175-b667-4144-8d5d-902219a2805b","Type":"ContainerDied","Data":"b7848a46cdf8d343499985cec2bd92e8935a0051c609e05117924d12c0877026"}
Sep 04 22:34:48.698263 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.697869    2564 scope.go:117] "RemoveContainer" containerID="8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373"
Sep 04 22:34:48.708811 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.708788    2564 scope.go:117] "RemoveContainer" containerID="8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373"
Sep 04 22:34:48.709103 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:34:48.709077    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373\": container with ID starting with 8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373 not found: ID does not exist" containerID="8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373"
Sep 04 22:34:48.709156 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.709106    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373"} err="failed to get container status \"8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373\": rpc error: code = NotFound desc = could not find container \"8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373\": container with ID starting with 8c60be72d9419371b2f168c512feb2658bc1420a00d47d3dda2a4804db8b6373 not found: ID does not exist"
Sep 04 22:34:48.723275 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.723249    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"]
Sep 04 22:34:48.732381 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:48.732358    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ef263a-7544b8d9b9-ql56d"]
Sep 04 22:34:50.672224 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:50.672191    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3315f175-b667-4144-8d5d-902219a2805b" path="/var/lib/kubelet/pods/3315f175-b667-4144-8d5d-902219a2805b/volumes"
Sep 04 22:34:56.525459 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:56.525422    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"]
Sep 04 22:34:56.525894 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:34:56.525672    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy" containerID="cri-o://c01058fce4646d8770a34256e928e96ab6fe298cbc9a1de3620d5f01889574df" gracePeriod=30
Sep 04 22:35:01.772176 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.772146    2564 generic.go:356] "Generic (PLEG): container finished" podID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerID="c01058fce4646d8770a34256e928e96ab6fe298cbc9a1de3620d5f01889574df" exitCode=0
Sep 04 22:35:01.772586 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.772232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" event={"ID":"775a4b9d-ef08-4e3e-b706-5e095b61e9c0","Type":"ContainerDied","Data":"c01058fce4646d8770a34256e928e96ab6fe298cbc9a1de3620d5f01889574df"}
Sep 04 22:35:01.772586 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.772309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9" event={"ID":"775a4b9d-ef08-4e3e-b706-5e095b61e9c0","Type":"ContainerDied","Data":"4591ab1776d5783211487aacd2a0ded4183c25880a1ebf5b617971741fe626f1"}
Sep 04 22:35:01.772586 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.772333    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4591ab1776d5783211487aacd2a0ded4183c25880a1ebf5b617971741fe626f1"
Sep 04 22:35:01.772586 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.772349    2564 scope.go:117] "RemoveContainer" containerID="3aba4724380e9b98c0505fdc887e0df0d3e8d2485fd47c8a434b4252a50a2079"
Sep 04 22:35:01.789859 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.789813    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:35:01.859541 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.859511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-data\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.859749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.859555    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istiod-ca-cert\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.859749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.859590    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-podinfo\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.859749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.859626    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-token\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.859749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.859684    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-credential-socket\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.859749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.859718    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-certs\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.860020 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.859831    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:01.860076 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860016    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:01.860076 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860037    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:01.860076 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860055    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:35:01.860232 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860104    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr8kp\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-kube-api-access-qr8kp\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.860232 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860149    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-socket\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.860232 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-envoy\") pod \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\" (UID: \"775a4b9d-ef08-4e3e-b706-5e095b61e9c0\") "
Sep 04 22:35:01.860414 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860394    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:01.860584 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860561    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.860584 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860582    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.860794 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860590    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.860794 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860635    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.860794 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.860650    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.862080 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.862045    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:35:01.862315 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.862280    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:35:01.862454 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.862431    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-kube-api-access-qr8kp" (OuterVolumeSpecName: "kube-api-access-qr8kp") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "kube-api-access-qr8kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:35:01.862527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.862512    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "775a4b9d-ef08-4e3e-b706-5e095b61e9c0" (UID: "775a4b9d-ef08-4e3e-b706-5e095b61e9c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:01.961757 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.961712    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr8kp\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-kube-api-access-qr8kp\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.961757 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.961749    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.961757 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.961763    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:01.961991 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:01.961773    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/775a4b9d-ef08-4e3e-b706-5e095b61e9c0-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:02.779127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:02.779102    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"
Sep 04 22:35:02.839250 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:02.839218    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"]
Sep 04 22:35:02.841429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:02.841407    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ef263a-openshift-default-cfc449c48-drvl9"]
Sep 04 22:35:04.671134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:04.671103    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" path="/var/lib/kubelet/pods/775a4b9d-ef08-4e3e-b706-5e095b61e9c0/volumes"
Sep 04 22:35:07.563716 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.563668    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"]
Sep 04 22:35:07.564165 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.563955    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s" podUID="354cf6d8-8e2f-4361-97f9-45455761c8e5" containerName="maas-api" containerID="cri-o://d93501d2c6b7c715f94fb11410fa757411e3f096c74bc8ca38149acbe46fd1b0" gracePeriod=30
Sep 04 22:35:07.815786 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.815711    2564 generic.go:356] "Generic (PLEG): container finished" podID="354cf6d8-8e2f-4361-97f9-45455761c8e5" containerID="d93501d2c6b7c715f94fb11410fa757411e3f096c74bc8ca38149acbe46fd1b0" exitCode=0
Sep 04 22:35:07.815919 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.815785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s" event={"ID":"354cf6d8-8e2f-4361-97f9-45455761c8e5","Type":"ContainerDied","Data":"d93501d2c6b7c715f94fb11410fa757411e3f096c74bc8ca38149acbe46fd1b0"}
Sep 04 22:35:07.815919 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.815851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s" event={"ID":"354cf6d8-8e2f-4361-97f9-45455761c8e5","Type":"ContainerDied","Data":"380358e99fd17ada840ef31a841da82950db950a35de81fa0d5e380c6a667560"}
Sep 04 22:35:07.815919 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.815879    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="380358e99fd17ada840ef31a841da82950db950a35de81fa0d5e380c6a667560"
Sep 04 22:35:07.820982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.820961    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:35:07.922782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.922749    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/354cf6d8-8e2f-4361-97f9-45455761c8e5-openshift-service-ca\") pod \"354cf6d8-8e2f-4361-97f9-45455761c8e5\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") "
Sep 04 22:35:07.922967 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.922834    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbz77\" (UniqueName: \"kubernetes.io/projected/354cf6d8-8e2f-4361-97f9-45455761c8e5-kube-api-access-hbz77\") pod \"354cf6d8-8e2f-4361-97f9-45455761c8e5\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") "
Sep 04 22:35:07.922967 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.922897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-metrics-certs\") pod \"354cf6d8-8e2f-4361-97f9-45455761c8e5\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") "
Sep 04 22:35:07.922967 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.922946    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls\") pod \"354cf6d8-8e2f-4361-97f9-45455761c8e5\" (UID: \"354cf6d8-8e2f-4361-97f9-45455761c8e5\") "
Sep 04 22:35:07.923130 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.923088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/354cf6d8-8e2f-4361-97f9-45455761c8e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "354cf6d8-8e2f-4361-97f9-45455761c8e5" (UID: "354cf6d8-8e2f-4361-97f9-45455761c8e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:35:07.923283 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.923265    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/354cf6d8-8e2f-4361-97f9-45455761c8e5-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:07.924998 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.924968    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "354cf6d8-8e2f-4361-97f9-45455761c8e5" (UID: "354cf6d8-8e2f-4361-97f9-45455761c8e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:35:07.924998 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.924983    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/354cf6d8-8e2f-4361-97f9-45455761c8e5-kube-api-access-hbz77" (OuterVolumeSpecName: "kube-api-access-hbz77") pod "354cf6d8-8e2f-4361-97f9-45455761c8e5" (UID: "354cf6d8-8e2f-4361-97f9-45455761c8e5"). InnerVolumeSpecName "kube-api-access-hbz77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:35:07.925151 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:07.925047    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "354cf6d8-8e2f-4361-97f9-45455761c8e5" (UID: "354cf6d8-8e2f-4361-97f9-45455761c8e5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:35:08.024101 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:08.024067    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:08.024101 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:08.024097    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/354cf6d8-8e2f-4361-97f9-45455761c8e5-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:08.024101 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:08.024107    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbz77\" (UniqueName: \"kubernetes.io/projected/354cf6d8-8e2f-4361-97f9-45455761c8e5-kube-api-access-hbz77\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:08.821829 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:08.821795    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"
Sep 04 22:35:08.866798 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:08.866759    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"]
Sep 04 22:35:08.868657 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:08.868633    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f64b20-7fdcbb9fb8-9sz9s"]
Sep 04 22:35:10.671853 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:10.671821    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="354cf6d8-8e2f-4361-97f9-45455761c8e5" path="/var/lib/kubelet/pods/354cf6d8-8e2f-4361-97f9-45455761c8e5/volumes"
Sep 04 22:35:17.673085 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:17.673046    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"]
Sep 04 22:35:17.673577 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:17.673285    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy" containerID="cri-o://48d87f2c9e1e87a9f8eead494fc43fedada265547fa871966028d1c241beaf52" gracePeriod=30
Sep 04 22:35:21.792964 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:21.792921    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 04 22:35:21.793333 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:21.793057    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 04 22:35:22.898892 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:22.898862    2564 generic.go:356] "Generic (PLEG): container finished" podID="73378b07-5422-4af2-a780-b1048478ca2b" containerID="48d87f2c9e1e87a9f8eead494fc43fedada265547fa871966028d1c241beaf52" exitCode=0
Sep 04 22:35:22.899237 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:22.898912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" event={"ID":"73378b07-5422-4af2-a780-b1048478ca2b","Type":"ContainerDied","Data":"48d87f2c9e1e87a9f8eead494fc43fedada265547fa871966028d1c241beaf52"}
Sep 04 22:35:22.899237 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:22.898958    2564 scope.go:117] "RemoveContainer" containerID="7398819c3c0061dd33f4214ada99ac854dd8277f1936514dcc9526a7edde4eb3"
Sep 04 22:35:22.940127 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:22.940074    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:35:23.065724 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065689    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73378b07-5422-4af2-a780-b1048478ca2b-istiod-ca-cert\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.065724 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065729    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-credential-socket\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.065954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065754    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-envoy\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.065954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-istio-token\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.065954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065816    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dpj7\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-kube-api-access-7dpj7\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.065954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065835    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-socket\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.065954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-certs\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.065954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065944    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73378b07-5422-4af2-a780-b1048478ca2b-istio-podinfo\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.066276 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065992    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-data\") pod \"73378b07-5422-4af2-a780-b1048478ca2b\" (UID: \"73378b07-5422-4af2-a780-b1048478ca2b\") "
Sep 04 22:35:23.066276 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.065999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:23.066276 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066182    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:23.066276 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73378b07-5422-4af2-a780-b1048478ca2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:35:23.066276 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066203    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:23.066525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:23.066525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066426    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.066525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066447    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.066525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066461    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73378b07-5422-4af2-a780-b1048478ca2b-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.066525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.066474    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.068088 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.068054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:35:23.068223 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.068170    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-kube-api-access-7dpj7" (OuterVolumeSpecName: "kube-api-access-7dpj7") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "kube-api-access-7dpj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:35:23.068452 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.068433    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:35:23.068524 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.068451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73378b07-5422-4af2-a780-b1048478ca2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73378b07-5422-4af2-a780-b1048478ca2b" (UID: "73378b07-5422-4af2-a780-b1048478ca2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:35:23.167791 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.167766    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.167791 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.167788    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.167952 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.167798    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dpj7\" (UniqueName: \"kubernetes.io/projected/73378b07-5422-4af2-a780-b1048478ca2b-kube-api-access-7dpj7\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.167952 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.167808    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73378b07-5422-4af2-a780-b1048478ca2b-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.167952 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.167817    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73378b07-5422-4af2-a780-b1048478ca2b-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:35:23.904965 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.904930    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"
Sep 04 22:35:23.905323 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.904938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89" event={"ID":"73378b07-5422-4af2-a780-b1048478ca2b","Type":"ContainerDied","Data":"ed43bc8ebe31f7652201c11b0d61ff408a73249ca7cbb9a86c32cb4050a7780a"}
Sep 04 22:35:23.905323 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.905068    2564 scope.go:117] "RemoveContainer" containerID="48d87f2c9e1e87a9f8eead494fc43fedada265547fa871966028d1c241beaf52"
Sep 04 22:35:23.940431 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.940403    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"]
Sep 04 22:35:23.945942 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:23.945921    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f64b20-openshift-default-575db5c7f8-5tn89"]
Sep 04 22:35:24.671663 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:24.671629    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73378b07-5422-4af2-a780-b1048478ca2b" path="/var/lib/kubelet/pods/73378b07-5422-4af2-a780-b1048478ca2b/volumes"
Sep 04 22:35:44.683011 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.682970    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"]
Sep 04 22:35:44.683590 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683566    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683594    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683626    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683635    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683646    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683654    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683669    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683677    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683700    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88b59bb-a65b-453d-a850-80d9c94fd340" containerName="main"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683709    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88b59bb-a65b-453d-a850-80d9c94fd340" containerName="main"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683726    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3315f175-b667-4144-8d5d-902219a2805b" containerName="maas-api"
Sep 04 22:35:44.683729 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683734    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3315f175-b667-4144-8d5d-902219a2805b" containerName="maas-api"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683749    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683757    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683767    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="354cf6d8-8e2f-4361-97f9-45455761c8e5" containerName="maas-api"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683775    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="354cf6d8-8e2f-4361-97f9-45455761c8e5" containerName="maas-api"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683885    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683898    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c88b59bb-a65b-453d-a850-80d9c94fd340" containerName="main"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683908    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683918    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed4887c-2a18-45c0-89c3-6a077c7e8e22" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683928    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73378b07-5422-4af2-a780-b1048478ca2b" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683938    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683947    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3315f175-b667-4144-8d5d-902219a2805b" containerName="maas-api"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683956    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy"
Sep 04 22:35:44.684260 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.683967    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="354cf6d8-8e2f-4361-97f9-45455761c8e5" containerName="maas-api"
Sep 04 22:35:44.688826 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.688805    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.693065 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.693043    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-2df128-openshift-default-dockercfg-c2bbd\""
Sep 04 22:35:44.759276 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istiod-ca-cert\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-credential-socket\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-token\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6cq7\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-kube-api-access-n6cq7\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-podinfo\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-data\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-socket\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-certs\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.759582 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.759571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-envoy\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860498 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-token\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860498 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6cq7\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-kube-api-access-n6cq7\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-podinfo\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-data\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-socket\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860768 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-certs\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860981 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860773    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-envoy\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860981 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istiod-ca-cert\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.860981 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.860847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-credential-socket\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.861206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.861180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-socket\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.861274 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.861205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-data\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.861274 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.861252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-certs\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.861527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.861504    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-credential-socket\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.861751 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.861725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istiod-ca-cert\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.863099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.863066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-envoy\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.863404 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.863386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-podinfo\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.868848 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.868826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"]
Sep 04 22:35:44.888527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.888503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-token\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.910482 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.910464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6cq7\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-kube-api-access-n6cq7\") pod \"e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") " pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:44.999073 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:44.998999    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:45.328760 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:45.328730    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"]
Sep 04 22:35:45.330817 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:35:45.330790    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ab06c1_b8b1_4847_a535_d444c3a3bb9b.slice/crio-94be6c283e9b96c30e63b92f15f94134d2017f06b13f5c7840ef6ce7cebce5ee WatchSource:0}: Error finding container 94be6c283e9b96c30e63b92f15f94134d2017f06b13f5c7840ef6ce7cebce5ee: Status 404 returned error can't find the container with id 94be6c283e9b96c30e63b92f15f94134d2017f06b13f5c7840ef6ce7cebce5ee
Sep 04 22:35:45.332984 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:45.332951    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:35:45.333054 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:45.333016    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:35:45.333054 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:45.333048    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:35:46.023929 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:46.023894    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" event={"ID":"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b","Type":"ContainerStarted","Data":"a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960"}
Sep 04 22:35:46.024315 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:46.023957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" event={"ID":"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b","Type":"ContainerStarted","Data":"94be6c283e9b96c30e63b92f15f94134d2017f06b13f5c7840ef6ce7cebce5ee"}
Sep 04 22:35:46.072000 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:46.071948    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podStartSLOduration=2.07193289 podStartE2EDuration="2.07193289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:35:46.070067826 +0000 UTC m=+1619.874425350" watchObservedRunningTime="2026-09-04 22:35:46.07193289 +0000 UTC m=+1619.876290414"
Sep 04 22:35:46.856688 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:46.856659    2564 scope.go:117] "RemoveContainer" containerID="d93501d2c6b7c715f94fb11410fa757411e3f096c74bc8ca38149acbe46fd1b0"
Sep 04 22:35:46.999363 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:46.999336    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:47.004534 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:47.004507    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:47.028871 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:47.028849    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:35:47.029653 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:35:47.029633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:36:03.069804 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:03.069759    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:36:03.070324 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:03.069837    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:36:04.122918 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:04.122885    2564 generic.go:356] "Generic (PLEG): container finished" podID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerID="a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960" exitCode=0
Sep 04 22:36:04.123309 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:04.122929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" event={"ID":"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b","Type":"ContainerDied","Data":"a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960"}
Sep 04 22:36:04.123351 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:04.123306    2564 scope.go:117] "RemoveContainer" containerID="a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960"
Sep 04 22:36:04.124395 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:04.124367    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:36:04.124453 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:04.124434    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:36:04.124488 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:04.124465    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:36:05.130143 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:05.130112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" event={"ID":"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b","Type":"ContainerStarted","Data":"c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397"}
Sep 04 22:36:05.999777 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:05.999736    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:36:05.999989 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:05.999934    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 04 22:36:06.000078 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:06.000013    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 04 22:36:06.999711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:06.999667    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 04 22:36:07.000088 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:06.999732    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 04 22:36:07.999504 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:07.999465    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 04 22:36:07.999711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:07.999520    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 04 22:36:08.999744 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:08.999703    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 04 22:36:09.000132 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:08.999762    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 04 22:36:09.999874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:09.999828    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 04 22:36:10.000370 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:09.999887    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 04 22:36:11.003154 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:11.003123    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:36:11.003518 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:11.003390    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:36:11.004064 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:11.004047    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:36:18.715516 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.715479    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"]
Sep 04 22:36:18.716149 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.716127    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy"
Sep 04 22:36:18.716200 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.716153    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="775a4b9d-ef08-4e3e-b706-5e095b61e9c0" containerName="istio-proxy"
Sep 04 22:36:18.719836 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.719818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.723830 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.723808    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-ecfcad-serving-cert\""
Sep 04 22:36:18.731644 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.731590    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"]
Sep 04 22:36:18.787898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.787866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-metrics-certs\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.788064 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.787903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkvx4\" (UniqueName: \"kubernetes.io/projected/1ad61095-46ce-4cae-a19e-bee9d15a952e-kube-api-access-qkvx4\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.788064 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.787935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad61095-46ce-4cae-a19e-bee9d15a952e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.788064 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.788009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.888516 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.888485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-metrics-certs\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.888516 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.888519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkvx4\" (UniqueName: \"kubernetes.io/projected/1ad61095-46ce-4cae-a19e-bee9d15a952e-kube-api-access-qkvx4\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.888778 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.888555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad61095-46ce-4cae-a19e-bee9d15a952e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.888778 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.888595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.889327 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.889299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad61095-46ce-4cae-a19e-bee9d15a952e-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.890943 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.890916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-metrics-certs\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.891035 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.890948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:18.904040 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:18.904017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkvx4\" (UniqueName: \"kubernetes.io/projected/1ad61095-46ce-4cae-a19e-bee9d15a952e-kube-api-access-qkvx4\") pod \"maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:19.032124 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:19.032040    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:19.315419 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:19.315390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"]
Sep 04 22:36:19.316649 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:36:19.316620    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad61095_46ce_4cae_a19e_bee9d15a952e.slice/crio-306ac6c51462d3370535290381f6c27734d1ec851987f160d6b14f5c8e0d4582 WatchSource:0}: Error finding container 306ac6c51462d3370535290381f6c27734d1ec851987f160d6b14f5c8e0d4582: Status 404 returned error can't find the container with id 306ac6c51462d3370535290381f6c27734d1ec851987f160d6b14f5c8e0d4582
Sep 04 22:36:20.220667 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:20.220627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8" event={"ID":"1ad61095-46ce-4cae-a19e-bee9d15a952e","Type":"ContainerStarted","Data":"7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396"}
Sep 04 22:36:20.221076 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:20.220738    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:36:20.221076 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:20.220767    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8" event={"ID":"1ad61095-46ce-4cae-a19e-bee9d15a952e","Type":"ContainerStarted","Data":"306ac6c51462d3370535290381f6c27734d1ec851987f160d6b14f5c8e0d4582"}
Sep 04 22:36:20.251429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:20.251382    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8" podStartSLOduration=1.909877759 podStartE2EDuration="2.251368285s" totalImagesPullingTime="341.490526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:36:20.250141748 +0000 UTC m=+1654.054499271" watchObservedRunningTime="2026-09-04 22:36:20.251368285 +0000 UTC m=+1654.055725808"
Sep 04 22:36:26.230981 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:36:26.230953    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:37:21.316568 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.316492    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"]
Sep 04 22:37:21.320268 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.320247    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.323458 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.323440    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-919fd8-openshift-default-dockercfg-m7g4d\""
Sep 04 22:37:21.337490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.337462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"]
Sep 04 22:37:21.379684 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-envoy\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.379846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-socket\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.379846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-podinfo\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.379846 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-credential-socket\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.380019 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-data\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.380019 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-token\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.380019 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.380019 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.379981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-certs\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.380178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.380037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xw8z\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-kube-api-access-2xw8z\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xw8z\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-kube-api-access-2xw8z\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-envoy\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-socket\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-podinfo\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-credential-socket\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-data\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-token\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481301 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481716 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-certs\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481716 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-data\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481716 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-socket\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481746    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-credential-socket\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.481874 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.481780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-certs\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.482058 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.482037    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.483549 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.483524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-envoy\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.483982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.483962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-podinfo\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.491015 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.490994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-token\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.491362 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.491332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xw8z\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-kube-api-access-2xw8z\") pod \"e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") " pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.630830 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.630736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:21.919469 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.919391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"]
Sep 04 22:37:21.925427 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:37:21.925400    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9412ed5_cbb5_4b2c_8a67_d15e7f015d8a.slice/crio-44607ed5c281fee05b9c1da85b33e82c1f64181cc515a54b44af9c61b089a1c5 WatchSource:0}: Error finding container 44607ed5c281fee05b9c1da85b33e82c1f64181cc515a54b44af9c61b089a1c5: Status 404 returned error can't find the container with id 44607ed5c281fee05b9c1da85b33e82c1f64181cc515a54b44af9c61b089a1c5
Sep 04 22:37:21.928265 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.928221    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:37:21.928390 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.928312    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:37:21.928390 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:21.928353    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:37:22.541783 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:22.541739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" event={"ID":"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a","Type":"ContainerStarted","Data":"ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909"}
Sep 04 22:37:22.542162 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:22.541826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" event={"ID":"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a","Type":"ContainerStarted","Data":"44607ed5c281fee05b9c1da85b33e82c1f64181cc515a54b44af9c61b089a1c5"}
Sep 04 22:37:22.567484 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:22.567430    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podStartSLOduration=1.567415133 podStartE2EDuration="1.567415133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:37:22.564877589 +0000 UTC m=+1716.369235126" watchObservedRunningTime="2026-09-04 22:37:22.567415133 +0000 UTC m=+1716.371772657"
Sep 04 22:37:22.631474 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:22.631443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:22.636853 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:22.636832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:23.546778 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:23.546746    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:23.547577 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:23.547551    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:39.588774 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:39.588733    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 04 22:37:39.589161 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:39.588805    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 04 22:37:40.648707 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:40.648676    2564 generic.go:356] "Generic (PLEG): container finished" podID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerID="ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909" exitCode=0
Sep 04 22:37:40.649071 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:40.648751    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" event={"ID":"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a","Type":"ContainerDied","Data":"ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909"}
Sep 04 22:37:40.649191 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:40.649177    2564 scope.go:117] "RemoveContainer" containerID="ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909"
Sep 04 22:37:40.650253 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:40.650227    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:37:40.650303 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:40.650295    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:37:40.650346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:40.650326    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 04 22:37:41.659796 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:41.659746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" event={"ID":"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a","Type":"ContainerStarted","Data":"34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f"}
Sep 04 22:37:42.631409 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:42.631372    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:42.631625 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:42.631582    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 04 22:37:42.631684 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:42.631654    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 04 22:37:43.631473 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:43.631441    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 04 22:37:43.631875 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:43.631495    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 04 22:37:44.631713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:44.631671    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 04 22:37:44.632101 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:44.631744    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 04 22:37:45.631067 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:45.631034    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 04 22:37:45.631247 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:45.631088    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 04 22:37:46.631331 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:46.631288    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 04 22:37:46.631722 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:46.631363    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 04 22:37:47.635788 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:47.635756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:47.636247 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:47.636121    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:37:47.636967 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:37:47.636945    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:38:03.696089 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:03.696055    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"]
Sep 04 22:38:03.696668 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:03.696304    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy" containerID="cri-o://34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f" gracePeriod=30
Sep 04 22:38:08.941219 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:08.941190    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:38:09.045279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045207    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-credential-socket\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045279 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045259    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xw8z\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-kube-api-access-2xw8z\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045291    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-token\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045380    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-socket\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045490 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045411    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istiod-ca-cert\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045489    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-certs\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045531    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-data\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045533    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:38:09.045769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045564    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-envoy\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-podinfo\") pod \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\" (UID: \"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a\") "
Sep 04 22:38:09.045769 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045756    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:38:09.046099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.045903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:38:09.046099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.046003    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:38:09.046099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.046031    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.046099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.046055    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.046099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.046070    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.046099 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.046066    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:38:09.047569 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.047540    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:38:09.047708 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.047594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:38:09.047773 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.047753    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-kube-api-access-2xw8z" (OuterVolumeSpecName: "kube-api-access-2xw8z") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "kube-api-access-2xw8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:38:09.047888 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.047870    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" (UID: "f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:38:09.147040 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.147014    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.147040 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.147036    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.147040 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.147045    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xw8z\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-kube-api-access-2xw8z\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.147220 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.147055    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.147220 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.147064    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.147220 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.147074    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:38:09.814435 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.814403    2564 generic.go:356] "Generic (PLEG): container finished" podID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerID="34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f" exitCode=0
Sep 04 22:38:09.814595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.814449    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"
Sep 04 22:38:09.814595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.814463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" event={"ID":"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a","Type":"ContainerDied","Data":"34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f"}
Sep 04 22:38:09.814595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.814504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr" event={"ID":"f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a","Type":"ContainerDied","Data":"44607ed5c281fee05b9c1da85b33e82c1f64181cc515a54b44af9c61b089a1c5"}
Sep 04 22:38:09.814595 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.814525    2564 scope.go:117] "RemoveContainer" containerID="34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f"
Sep 04 22:38:09.824658 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.824640    2564 scope.go:117] "RemoveContainer" containerID="ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909"
Sep 04 22:38:09.832472 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.832453    2564 scope.go:117] "RemoveContainer" containerID="34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f"
Sep 04 22:38:09.832742 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:38:09.832721    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f\": container with ID starting with 34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f not found: ID does not exist" containerID="34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f"
Sep 04 22:38:09.832790 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.832750    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f"} err="failed to get container status \"34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f\": rpc error: code = NotFound desc = could not find container \"34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f\": container with ID starting with 34c80ef5e00df7aa74619262567c7f5c21b32ec31edbb97eb74014f87e6fd37f not found: ID does not exist"
Sep 04 22:38:09.832790 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.832768    2564 scope.go:117] "RemoveContainer" containerID="ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909"
Sep 04 22:38:09.832995 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:38:09.832980    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909\": container with ID starting with ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909 not found: ID does not exist" containerID="ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909"
Sep 04 22:38:09.833036 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.833001    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909"} err="failed to get container status \"ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909\": rpc error: code = NotFound desc = could not find container \"ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909\": container with ID starting with ecd40d52e909fcd62269f7fc2d4dc9736aad93e28a4fa529019c9e69cfb10909 not found: ID does not exist"
Sep 04 22:38:09.840685 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.840662    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"]
Sep 04 22:38:09.846526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:09.846504    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-919fd8-openshift-default-7545bd669d-49chr"]
Sep 04 22:38:10.672477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:38:10.672442    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" path="/var/lib/kubelet/pods/f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a/volumes"
Sep 04 22:39:13.342293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:13.342254    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"]
Sep 04 22:39:13.342771 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:13.342461    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy" containerID="cri-o://c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397" gracePeriod=30
Sep 04 22:39:18.601625 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.601553    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:39:18.678171 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678145    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-token\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678182    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-socket\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678199    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6cq7\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-kube-api-access-n6cq7\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-envoy\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678244    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-certs\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678285    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-credential-socket\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678319    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-podinfo\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678346 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678343    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-data\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678390    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istiod-ca-cert\") pod \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\" (UID: \"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b\") "
Sep 04 22:39:18.678753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:39:18.678753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678726    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:39:18.678909 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678758    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:39:18.678909 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678760    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.679023 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.678926    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:39:18.679078 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.679048    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:39:18.680570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.680541    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:39:18.680749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.680586    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:39:18.680749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.680593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:39:18.680749 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.680593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-kube-api-access-n6cq7" (OuterVolumeSpecName: "kube-api-access-n6cq7") pod "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" (UID: "d9ab06c1-b8b1-4847-a535-d444c3a3bb9b"). InnerVolumeSpecName "kube-api-access-n6cq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:39:18.779793 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779766    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6cq7\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-kube-api-access-n6cq7\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.779793 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779790    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.779954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779801    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.779954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779809    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.779954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779818    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.779954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779825    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.779954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779833    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:18.779954 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:18.779840    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:19.172098 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.172061    2564 generic.go:356] "Generic (PLEG): container finished" podID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerID="c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397" exitCode=0
Sep 04 22:39:19.172287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.172112    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"
Sep 04 22:39:19.172287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.172154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" event={"ID":"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b","Type":"ContainerDied","Data":"c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397"}
Sep 04 22:39:19.172287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.172221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z" event={"ID":"d9ab06c1-b8b1-4847-a535-d444c3a3bb9b","Type":"ContainerDied","Data":"94be6c283e9b96c30e63b92f15f94134d2017f06b13f5c7840ef6ce7cebce5ee"}
Sep 04 22:39:19.172287 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.172251    2564 scope.go:117] "RemoveContainer" containerID="c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397"
Sep 04 22:39:19.182124 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.182107    2564 scope.go:117] "RemoveContainer" containerID="a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960"
Sep 04 22:39:19.189963 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.189946    2564 scope.go:117] "RemoveContainer" containerID="c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397"
Sep 04 22:39:19.190242 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:39:19.190222    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397\": container with ID starting with c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397 not found: ID does not exist" containerID="c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397"
Sep 04 22:39:19.190292 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.190250    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397"} err="failed to get container status \"c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397\": rpc error: code = NotFound desc = could not find container \"c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397\": container with ID starting with c669d7f03d3988cb13dabcaa6e029ca4e6a0030c616770c4932e5ca6d1c91397 not found: ID does not exist"
Sep 04 22:39:19.190292 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.190268    2564 scope.go:117] "RemoveContainer" containerID="a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960"
Sep 04 22:39:19.190530 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:39:19.190512    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960\": container with ID starting with a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960 not found: ID does not exist" containerID="a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960"
Sep 04 22:39:19.190570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.190537    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960"} err="failed to get container status \"a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960\": rpc error: code = NotFound desc = could not find container \"a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960\": container with ID starting with a044ee4545ee475b9a7406b317c44f59a743c2af5c4ce7cfc3972c734514f960 not found: ID does not exist"
Sep 04 22:39:19.200695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.200673    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"]
Sep 04 22:39:19.205429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:19.205407    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-2df128-openshift-default-6d4d655d4d-2jq4z"]
Sep 04 22:39:20.670761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:20.670722    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" path="/var/lib/kubelet/pods/d9ab06c1-b8b1-4847-a535-d444c3a3bb9b/volumes"
Sep 04 22:39:24.361345 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.361312    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"]
Sep 04 22:39:24.361779 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.361541    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8" podUID="1ad61095-46ce-4cae-a19e-bee9d15a952e" containerName="maas-api" containerID="cri-o://7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396" gracePeriod=30
Sep 04 22:39:24.611492 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.611425    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:39:24.734570 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.734531    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkvx4\" (UniqueName: \"kubernetes.io/projected/1ad61095-46ce-4cae-a19e-bee9d15a952e-kube-api-access-qkvx4\") pod \"1ad61095-46ce-4cae-a19e-bee9d15a952e\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") "
Sep 04 22:39:24.734782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.734630    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad61095-46ce-4cae-a19e-bee9d15a952e-openshift-service-ca\") pod \"1ad61095-46ce-4cae-a19e-bee9d15a952e\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") "
Sep 04 22:39:24.734782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.734683    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-metrics-certs\") pod \"1ad61095-46ce-4cae-a19e-bee9d15a952e\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") "
Sep 04 22:39:24.734782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.734709    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-maas-api-tls\") pod \"1ad61095-46ce-4cae-a19e-bee9d15a952e\" (UID: \"1ad61095-46ce-4cae-a19e-bee9d15a952e\") "
Sep 04 22:39:24.736823 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.736791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ad61095-46ce-4cae-a19e-bee9d15a952e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ad61095-46ce-4cae-a19e-bee9d15a952e" (UID: "1ad61095-46ce-4cae-a19e-bee9d15a952e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:39:24.739238 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.739208    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ad61095-46ce-4cae-a19e-bee9d15a952e" (UID: "1ad61095-46ce-4cae-a19e-bee9d15a952e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:39:24.739369 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.739227    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ad61095-46ce-4cae-a19e-bee9d15a952e" (UID: "1ad61095-46ce-4cae-a19e-bee9d15a952e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:39:24.739919 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.739890    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad61095-46ce-4cae-a19e-bee9d15a952e-kube-api-access-qkvx4" (OuterVolumeSpecName: "kube-api-access-qkvx4") pod "1ad61095-46ce-4cae-a19e-bee9d15a952e" (UID: "1ad61095-46ce-4cae-a19e-bee9d15a952e"). InnerVolumeSpecName "kube-api-access-qkvx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:39:24.836692 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.836656    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkvx4\" (UniqueName: \"kubernetes.io/projected/1ad61095-46ce-4cae-a19e-bee9d15a952e-kube-api-access-qkvx4\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:24.836841 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.836694    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad61095-46ce-4cae-a19e-bee9d15a952e-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:24.836841 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.836715    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:24.836841 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:24.836729    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad61095-46ce-4cae-a19e-bee9d15a952e-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:25.205642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.205584    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ad61095-46ce-4cae-a19e-bee9d15a952e" containerID="7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396" exitCode=0
Sep 04 22:39:25.205642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.205638    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"
Sep 04 22:39:25.205866 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.205669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8" event={"ID":"1ad61095-46ce-4cae-a19e-bee9d15a952e","Type":"ContainerDied","Data":"7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396"}
Sep 04 22:39:25.205866 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.205725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8" event={"ID":"1ad61095-46ce-4cae-a19e-bee9d15a952e","Type":"ContainerDied","Data":"306ac6c51462d3370535290381f6c27734d1ec851987f160d6b14f5c8e0d4582"}
Sep 04 22:39:25.205866 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.205755    2564 scope.go:117] "RemoveContainer" containerID="7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396"
Sep 04 22:39:25.215207 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.215189    2564 scope.go:117] "RemoveContainer" containerID="7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396"
Sep 04 22:39:25.215467 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:39:25.215449    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396\": container with ID starting with 7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396 not found: ID does not exist" containerID="7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396"
Sep 04 22:39:25.215526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.215479    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396"} err="failed to get container status \"7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396\": rpc error: code = NotFound desc = could not find container \"7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396\": container with ID starting with 7eaeafac90eb0c239ea2b857a6b7e71b9532265d51ce65272238e19763d0d396 not found: ID does not exist"
Sep 04 22:39:25.228393 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.228369    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"]
Sep 04 22:39:25.235893 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:25.235873    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ecfcad-c7867d6bf-xrkp8"]
Sep 04 22:39:26.671711 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:26.671675    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad61095-46ce-4cae-a19e-bee9d15a952e" path="/var/lib/kubelet/pods/1ad61095-46ce-4cae-a19e-bee9d15a952e/volumes"
Sep 04 22:39:43.113898 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.113861    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"]
Sep 04 22:39:43.114385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.114071    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc" podUID="f4c8fb07-d6f0-462e-a438-2ea2b9b05918" containerName="maas-api" containerID="cri-o://309b8573d146f33843a57297c51ce8d12109774d6c2c44ddd802b8ed8766e461" gracePeriod=30
Sep 04 22:39:43.308665 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.308616    2564 generic.go:356] "Generic (PLEG): container finished" podID="f4c8fb07-d6f0-462e-a438-2ea2b9b05918" containerID="309b8573d146f33843a57297c51ce8d12109774d6c2c44ddd802b8ed8766e461" exitCode=0
Sep 04 22:39:43.308833 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.308686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc" event={"ID":"f4c8fb07-d6f0-462e-a438-2ea2b9b05918","Type":"ContainerDied","Data":"309b8573d146f33843a57297c51ce8d12109774d6c2c44ddd802b8ed8766e461"}
Sep 04 22:39:43.370150 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.370078    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:39:43.416033 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.415999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxn2m\" (UniqueName: \"kubernetes.io/projected/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-kube-api-access-nxn2m\") pod \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") "
Sep 04 22:39:43.416231 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.416049    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-openshift-service-ca\") pod \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") "
Sep 04 22:39:43.416231 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.416169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-metrics-certs\") pod \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") "
Sep 04 22:39:43.416373 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.416246    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls\") pod \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\" (UID: \"f4c8fb07-d6f0-462e-a438-2ea2b9b05918\") "
Sep 04 22:39:43.416435 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.416392    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4c8fb07-d6f0-462e-a438-2ea2b9b05918" (UID: "f4c8fb07-d6f0-462e-a438-2ea2b9b05918"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:39:43.416578 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.416558    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:43.418187 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.418157    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-kube-api-access-nxn2m" (OuterVolumeSpecName: "kube-api-access-nxn2m") pod "f4c8fb07-d6f0-462e-a438-2ea2b9b05918" (UID: "f4c8fb07-d6f0-462e-a438-2ea2b9b05918"). InnerVolumeSpecName "kube-api-access-nxn2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:39:43.418305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.418227    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f4c8fb07-d6f0-462e-a438-2ea2b9b05918" (UID: "f4c8fb07-d6f0-462e-a438-2ea2b9b05918"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:39:43.418305 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.418270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4c8fb07-d6f0-462e-a438-2ea2b9b05918" (UID: "f4c8fb07-d6f0-462e-a438-2ea2b9b05918"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:39:43.517660 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.517625    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:43.517660 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.517655    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:43.517660 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:43.517665    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxn2m\" (UniqueName: \"kubernetes.io/projected/f4c8fb07-d6f0-462e-a438-2ea2b9b05918-kube-api-access-nxn2m\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:39:44.315910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:44.315882    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"
Sep 04 22:39:44.315910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:44.315901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc" event={"ID":"f4c8fb07-d6f0-462e-a438-2ea2b9b05918","Type":"ContainerDied","Data":"f81bd7136ef6d12878ceb6ba1d63a1fd38b5cbd701e0dbb3b51f28e96c7044bb"}
Sep 04 22:39:44.316395 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:44.315991    2564 scope.go:117] "RemoveContainer" containerID="309b8573d146f33843a57297c51ce8d12109774d6c2c44ddd802b8ed8766e461"
Sep 04 22:39:44.341077 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:44.341047    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"]
Sep 04 22:39:44.347608 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:44.347573    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-bc62f0-698588945b-kp8fc"]
Sep 04 22:39:44.671437 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:39:44.671345    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c8fb07-d6f0-462e-a438-2ea2b9b05918" path="/var/lib/kubelet/pods/f4c8fb07-d6f0-462e-a438-2ea2b9b05918/volumes"
Sep 04 22:40:10.111330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:10.111248    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"]
Sep 04 22:40:10.111825 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:10.111483    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy" containerID="cri-o://ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3" gracePeriod=30
Sep 04 22:40:12.703563 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:12.703522    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fwvzq"]
Sep 04 22:40:12.704056 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:12.703808    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7db7fc5975-fwvzq" podUID="cf5382e6-c529-48a5-8075-bb7ed14a961f" containerName="manager" containerID="cri-o://e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c" gracePeriod=30
Sep 04 22:40:12.960849 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:12.960792    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:40:13.089861 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.089831    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-metrics-certs\") pod \"cf5382e6-c529-48a5-8075-bb7ed14a961f\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") "
Sep 04 22:40:13.090036 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.089893    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert\") pod \"cf5382e6-c529-48a5-8075-bb7ed14a961f\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") "
Sep 04 22:40:13.090036 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.090014    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw8cz\" (UniqueName: \"kubernetes.io/projected/cf5382e6-c529-48a5-8075-bb7ed14a961f-kube-api-access-sw8cz\") pod \"cf5382e6-c529-48a5-8075-bb7ed14a961f\" (UID: \"cf5382e6-c529-48a5-8075-bb7ed14a961f\") "
Sep 04 22:40:13.091917 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.091877    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cf5382e6-c529-48a5-8075-bb7ed14a961f" (UID: "cf5382e6-c529-48a5-8075-bb7ed14a961f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:40:13.092055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.092004    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cf5382e6-c529-48a5-8075-bb7ed14a961f" (UID: "cf5382e6-c529-48a5-8075-bb7ed14a961f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:40:13.092055 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.092014    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5382e6-c529-48a5-8075-bb7ed14a961f-kube-api-access-sw8cz" (OuterVolumeSpecName: "kube-api-access-sw8cz") pod "cf5382e6-c529-48a5-8075-bb7ed14a961f" (UID: "cf5382e6-c529-48a5-8075-bb7ed14a961f"). InnerVolumeSpecName "kube-api-access-sw8cz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:40:13.191642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.191596    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:13.191642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.191637    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf5382e6-c529-48a5-8075-bb7ed14a961f-webhook-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:13.191642 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.191648    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw8cz\" (UniqueName: \"kubernetes.io/projected/cf5382e6-c529-48a5-8075-bb7ed14a961f-kube-api-access-sw8cz\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:13.470206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.470170    2564 generic.go:356] "Generic (PLEG): container finished" podID="cf5382e6-c529-48a5-8075-bb7ed14a961f" containerID="e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c" exitCode=0
Sep 04 22:40:13.470412 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.470220    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-fwvzq"
Sep 04 22:40:13.470412 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.470259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-fwvzq" event={"ID":"cf5382e6-c529-48a5-8075-bb7ed14a961f","Type":"ContainerDied","Data":"e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c"}
Sep 04 22:40:13.470412 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.470323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-fwvzq" event={"ID":"cf5382e6-c529-48a5-8075-bb7ed14a961f","Type":"ContainerDied","Data":"95ec71dae407b0eeb9096c57e4f3b000cf6d61ea476a430a8ae2df0903769bd9"}
Sep 04 22:40:13.470412 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.470353    2564 scope.go:117] "RemoveContainer" containerID="e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c"
Sep 04 22:40:13.479870 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.479851    2564 scope.go:117] "RemoveContainer" containerID="e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c"
Sep 04 22:40:13.480147 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:40:13.480128    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c\": container with ID starting with e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c not found: ID does not exist" containerID="e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c"
Sep 04 22:40:13.480199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.480156    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c"} err="failed to get container status \"e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c\": rpc error: code = NotFound desc = could not find container \"e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c\": container with ID starting with e551f07c6d3fb066967d809b3dadde2ca222518463567cc843310d5b2e891c9c not found: ID does not exist"
Sep 04 22:40:13.494950 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.494924    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fwvzq"]
Sep 04 22:40:13.503531 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:13.503510    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fwvzq"]
Sep 04 22:40:14.671178 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:14.671145    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf5382e6-c529-48a5-8075-bb7ed14a961f" path="/var/lib/kubelet/pods/cf5382e6-c529-48a5-8075-bb7ed14a961f/volumes"
Sep 04 22:40:15.373671 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.373648    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:40:15.484387 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.484308    2564 generic.go:356] "Generic (PLEG): container finished" podID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerID="ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3" exitCode=0
Sep 04 22:40:15.484387 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.484354    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"
Sep 04 22:40:15.484387 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.484372    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" event={"ID":"0c682895-fbca-4505-8f94-92a3c2a750d8","Type":"ContainerDied","Data":"ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3"}
Sep 04 22:40:15.484620 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.484436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45" event={"ID":"0c682895-fbca-4505-8f94-92a3c2a750d8","Type":"ContainerDied","Data":"eec5bef4a75b686babac6b93e3770ed3a4decee41c017f47953c61036fa7efd9"}
Sep 04 22:40:15.484620 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.484460    2564 scope.go:117] "RemoveContainer" containerID="ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3"
Sep 04 22:40:15.493399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.493381    2564 scope.go:117] "RemoveContainer" containerID="0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66"
Sep 04 22:40:15.501032 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.501017    2564 scope.go:117] "RemoveContainer" containerID="ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3"
Sep 04 22:40:15.501289 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:40:15.501270    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3\": container with ID starting with ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3 not found: ID does not exist" containerID="ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3"
Sep 04 22:40:15.501336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.501298    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3"} err="failed to get container status \"ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3\": rpc error: code = NotFound desc = could not find container \"ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3\": container with ID starting with ffa5bf8645e13a784089fb0603d5693dbd5e7e21141f0c11185790e8b223adf3 not found: ID does not exist"
Sep 04 22:40:15.501336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.501313    2564 scope.go:117] "RemoveContainer" containerID="0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66"
Sep 04 22:40:15.501552 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:40:15.501537    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66\": container with ID starting with 0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66 not found: ID does not exist" containerID="0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66"
Sep 04 22:40:15.501592 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.501556    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66"} err="failed to get container status \"0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66\": rpc error: code = NotFound desc = could not find container \"0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66\": container with ID starting with 0cdbb8983079efb9b31de9692a7392e0a1b594790be6e52095c518a6a5f67a66 not found: ID does not exist"
Sep 04 22:40:15.512374 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512353    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-credential-socket\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512483 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512399    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-socket\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512483 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512436    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-data\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512483 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512472    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-certs\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512634 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512521    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-token\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512634 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512546    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-kube-api-access-2l7zw\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512634 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c682895-fbca-4505-8f94-92a3c2a750d8-istiod-ca-cert\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512745 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:40:15.512745 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512654    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-podinfo\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512745 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512735    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-envoy\") pod \"0c682895-fbca-4505-8f94-92a3c2a750d8\" (UID: \"0c682895-fbca-4505-8f94-92a3c2a750d8\") "
Sep 04 22:40:15.512887 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:40:15.512887 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:40:15.513097 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.512764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:40:15.513213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.513142    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-data\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.513213 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.513199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c682895-fbca-4505-8f94-92a3c2a750d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:40:15.513330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.513207    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.513330 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.513242    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-credential-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.514745 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.514721    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 04 22:40:15.515189 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.515162    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-kube-api-access-2l7zw" (OuterVolumeSpecName: "kube-api-access-2l7zw") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "kube-api-access-2l7zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:40:15.515277 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.515200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:40:15.515277 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.515228    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c682895-fbca-4505-8f94-92a3c2a750d8" (UID: "0c682895-fbca-4505-8f94-92a3c2a750d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:40:15.614529 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.614503    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-token\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.614529 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.614529    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l7zw\" (UniqueName: \"kubernetes.io/projected/0c682895-fbca-4505-8f94-92a3c2a750d8-kube-api-access-2l7zw\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.614710 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.614539    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c682895-fbca-4505-8f94-92a3c2a750d8-istiod-ca-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.614710 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.614547    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-podinfo\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.614710 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.614556    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-istio-envoy\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.614710 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.614565    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c682895-fbca-4505-8f94-92a3c2a750d8-workload-socket\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:40:15.810914 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.810881    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"]
Sep 04 22:40:15.817833 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:15.817806    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bf86db-openshift-default-b8d45d646-d8v45"]
Sep 04 22:40:16.670743 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:16.670707    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" path="/var/lib/kubelet/pods/0c682895-fbca-4505-8f94-92a3c2a750d8/volumes"
Sep 04 22:40:46.938083 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:40:46.938046    2564 scope.go:117] "RemoveContainer" containerID="c01058fce4646d8770a34256e928e96ab6fe298cbc9a1de3620d5f01889574df"
Sep 04 22:41:14.332161 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332124    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db7fc5975-6v6m2"]
Sep 04 22:41:14.332555 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332537    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy"
Sep 04 22:41:14.332617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332556    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy"
Sep 04 22:41:14.332617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332580    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy"
Sep 04 22:41:14.332617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332586    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy"
Sep 04 22:41:14.332617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332593    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf5382e6-c529-48a5-8075-bb7ed14a961f" containerName="manager"
Sep 04 22:41:14.332617 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332614    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf5382e6-c529-48a5-8075-bb7ed14a961f" containerName="manager"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332623    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332628    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332636    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c8fb07-d6f0-462e-a438-2ea2b9b05918" containerName="maas-api"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332641    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c8fb07-d6f0-462e-a438-2ea2b9b05918" containerName="maas-api"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332647    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332654    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332660    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332665    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332672    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332677    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332685    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad61095-46ce-4cae-a19e-bee9d15a952e" containerName="maas-api"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332690    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad61095-46ce-4cae-a19e-bee9d15a952e" containerName="maas-api"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332759    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332766    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf5382e6-c529-48a5-8075-bb7ed14a961f" containerName="manager"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332772    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332778    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy"
Sep 04 22:41:14.332782 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332784    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ab06c1-b8b1-4847-a535-d444c3a3bb9b" containerName="istio-proxy"
Sep 04 22:41:14.333277 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332791    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9412ed5-cbb5-4b2c-8a67-d15e7f015d8a" containerName="istio-proxy"
Sep 04 22:41:14.333277 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332796    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c8fb07-d6f0-462e-a438-2ea2b9b05918" containerName="maas-api"
Sep 04 22:41:14.333277 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.332802    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad61095-46ce-4cae-a19e-bee9d15a952e" containerName="maas-api"
Sep 04 22:41:14.335648 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.335630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.341525 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.341496    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 04 22:41:14.341676 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.341497    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 04 22:41:14.341676 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.341535    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 04 22:41:14.342460 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.342329    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2nskt\""
Sep 04 22:41:14.361026 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.360991    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-6v6m2"]
Sep 04 22:41:14.419216 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.419183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-metrics-certs\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.419385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.419223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhsr\" (UniqueName: \"kubernetes.io/projected/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-kube-api-access-hjhsr\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.419385 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.419292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-webhook-cert\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.520336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.520294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-metrics-certs\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.520336 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.520339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhsr\" (UniqueName: \"kubernetes.io/projected/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-kube-api-access-hjhsr\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.520586 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.520400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-webhook-cert\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.523041 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.523013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-metrics-certs\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.523134 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.523013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-webhook-cert\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.530250 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.530224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhsr\" (UniqueName: \"kubernetes.io/projected/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-kube-api-access-hjhsr\") pod \"maas-controller-7db7fc5975-6v6m2\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") " pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.645784 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.645706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:14.922327 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.922296    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-6v6m2"]
Sep 04 22:41:14.923848 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:41:14.923811    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d0dd3b_84a2_41b5_aca9_371fa8c15904.slice/crio-99b30597ee70a007f6c2666c287074095ae9710c2d8698064edc07e1d6f1db56 WatchSource:0}: Error finding container 99b30597ee70a007f6c2666c287074095ae9710c2d8698064edc07e1d6f1db56: Status 404 returned error can't find the container with id 99b30597ee70a007f6c2666c287074095ae9710c2d8698064edc07e1d6f1db56
Sep 04 22:41:14.925203 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:14.925183    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 04 22:41:15.784396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:15.784292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-6v6m2" event={"ID":"a4d0dd3b-84a2-41b5-aca9-371fa8c15904","Type":"ContainerStarted","Data":"06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd"}
Sep 04 22:41:15.784396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:15.784347    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-6v6m2" event={"ID":"a4d0dd3b-84a2-41b5-aca9-371fa8c15904","Type":"ContainerStarted","Data":"99b30597ee70a007f6c2666c287074095ae9710c2d8698064edc07e1d6f1db56"}
Sep 04 22:41:15.784396 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:15.784374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:15.811284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:15.811220    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db7fc5975-6v6m2" podStartSLOduration=1.326543454 podStartE2EDuration="1.81120239s" totalImagesPullingTime="484.658936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:41:15.811048085 +0000 UTC m=+1949.615405613" watchObservedRunningTime="2026-09-04 22:41:15.81120239 +0000 UTC m=+1949.615559914"
Sep 04 22:41:26.792123 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:26.792084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:36.158036 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.158000    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-6v6m2"]
Sep 04 22:41:36.158447 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.158195    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7db7fc5975-6v6m2" podUID="a4d0dd3b-84a2-41b5-aca9-371fa8c15904" containerName="manager" containerID="cri-o://06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd" gracePeriod=30
Sep 04 22:41:36.404371 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.404349    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:36.526637 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.526533    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjhsr\" (UniqueName: \"kubernetes.io/projected/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-kube-api-access-hjhsr\") pod \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") "
Sep 04 22:41:36.526637 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.526624    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-metrics-certs\") pod \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") "
Sep 04 22:41:36.526858 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.526660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-webhook-cert\") pod \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\" (UID: \"a4d0dd3b-84a2-41b5-aca9-371fa8c15904\") "
Sep 04 22:41:36.528527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.528496    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a4d0dd3b-84a2-41b5-aca9-371fa8c15904" (UID: "a4d0dd3b-84a2-41b5-aca9-371fa8c15904"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:41:36.528692 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.528578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-kube-api-access-hjhsr" (OuterVolumeSpecName: "kube-api-access-hjhsr") pod "a4d0dd3b-84a2-41b5-aca9-371fa8c15904" (UID: "a4d0dd3b-84a2-41b5-aca9-371fa8c15904"). InnerVolumeSpecName "kube-api-access-hjhsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:41:36.528692 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.528623    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a4d0dd3b-84a2-41b5-aca9-371fa8c15904" (UID: "a4d0dd3b-84a2-41b5-aca9-371fa8c15904"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:41:36.628078 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.628042    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:41:36.628078 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.628070    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-webhook-cert\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:41:36.628078 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.628080    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjhsr\" (UniqueName: \"kubernetes.io/projected/a4d0dd3b-84a2-41b5-aca9-371fa8c15904-kube-api-access-hjhsr\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:41:36.888808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.888774    2564 generic.go:356] "Generic (PLEG): container finished" podID="a4d0dd3b-84a2-41b5-aca9-371fa8c15904" containerID="06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd" exitCode=0
Sep 04 22:41:36.888995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.888815    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-6v6m2"
Sep 04 22:41:36.888995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.888865    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-6v6m2" event={"ID":"a4d0dd3b-84a2-41b5-aca9-371fa8c15904","Type":"ContainerDied","Data":"06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd"}
Sep 04 22:41:36.888995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.888909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-6v6m2" event={"ID":"a4d0dd3b-84a2-41b5-aca9-371fa8c15904","Type":"ContainerDied","Data":"99b30597ee70a007f6c2666c287074095ae9710c2d8698064edc07e1d6f1db56"}
Sep 04 22:41:36.888995 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.888930    2564 scope.go:117] "RemoveContainer" containerID="06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd"
Sep 04 22:41:36.897636 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.897619    2564 scope.go:117] "RemoveContainer" containerID="06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd"
Sep 04 22:41:36.897918 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:41:36.897896    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd\": container with ID starting with 06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd not found: ID does not exist" containerID="06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd"
Sep 04 22:41:36.897988 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.897930    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd"} err="failed to get container status \"06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd\": rpc error: code = NotFound desc = could not find container \"06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd\": container with ID starting with 06f7392e22dd9758a577ddd496e03c303509b0d8e963459b4ec6f086dfb1c3bd not found: ID does not exist"
Sep 04 22:41:36.909966 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.909940    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-6v6m2"]
Sep 04 22:41:36.921242 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:36.917650    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-6v6m2"]
Sep 04 22:41:37.747803 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.747765    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fsx6v"]
Sep 04 22:41:37.748186 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.748173    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d0dd3b-84a2-41b5-aca9-371fa8c15904" containerName="manager"
Sep 04 22:41:37.748231 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.748187    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d0dd3b-84a2-41b5-aca9-371fa8c15904" containerName="manager"
Sep 04 22:41:37.748267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.748255    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4d0dd3b-84a2-41b5-aca9-371fa8c15904" containerName="manager"
Sep 04 22:41:37.748267 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.748266    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c682895-fbca-4505-8f94-92a3c2a750d8" containerName="istio-proxy"
Sep 04 22:41:37.752756 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.752739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.755799 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.755772    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 04 22:41:37.756488 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.756471    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2nskt\""
Sep 04 22:41:37.756552 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.756471    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 04 22:41:37.756624 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.756548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 04 22:41:37.767770 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.767745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fsx6v"]
Sep 04 22:41:37.838013 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.837974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-metrics-certs\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.838154 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.838116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s55kc\" (UniqueName: \"kubernetes.io/projected/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-kube-api-access-s55kc\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.838272 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.838252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-webhook-cert\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.939527 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.939492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-webhook-cert\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.939713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.939538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-metrics-certs\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.939713 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.939612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s55kc\" (UniqueName: \"kubernetes.io/projected/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-kube-api-access-s55kc\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.941975 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.941950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-webhook-cert\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.942084 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.942070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-metrics-certs\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:37.954135 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:37.954110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s55kc\" (UniqueName: \"kubernetes.io/projected/6384d6b0-e7dd-48af-bd69-f0f1fc64f576-kube-api-access-s55kc\") pod \"maas-controller-7db7fc5975-fsx6v\" (UID: \"6384d6b0-e7dd-48af-bd69-f0f1fc64f576\") " pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:38.062753 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:38.062669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:38.338067 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:38.338042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db7fc5975-fsx6v"]
Sep 04 22:41:38.339248 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:41:38.339224    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6384d6b0_e7dd_48af_bd69_f0f1fc64f576.slice/crio-b206f39a288b73a767b918f3f9be7908ba66821a527048259a000b124537d023 WatchSource:0}: Error finding container b206f39a288b73a767b918f3f9be7908ba66821a527048259a000b124537d023: Status 404 returned error can't find the container with id b206f39a288b73a767b918f3f9be7908ba66821a527048259a000b124537d023
Sep 04 22:41:38.674027 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:38.673940    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d0dd3b-84a2-41b5-aca9-371fa8c15904" path="/var/lib/kubelet/pods/a4d0dd3b-84a2-41b5-aca9-371fa8c15904/volumes"
Sep 04 22:41:38.902212 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:38.902135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-fsx6v" event={"ID":"6384d6b0-e7dd-48af-bd69-f0f1fc64f576","Type":"ContainerStarted","Data":"b206f39a288b73a767b918f3f9be7908ba66821a527048259a000b124537d023"}
Sep 04 22:41:39.908109 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:39.908076    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db7fc5975-fsx6v" event={"ID":"6384d6b0-e7dd-48af-bd69-f0f1fc64f576","Type":"ContainerStarted","Data":"8491a72fda4d116c84d8a70b4f129907e1315867dbbdd6fa7df5988b0deb6403"}
Sep 04 22:41:39.908506 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:39.908143    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:41:39.930399 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:39.930339    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db7fc5975-fsx6v" podStartSLOduration=1.711501593 podStartE2EDuration="2.930323165s" totalImagesPullingTime="1.218821572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:41:39.929278934 +0000 UTC m=+1973.733636458" watchObservedRunningTime="2026-09-04 22:41:39.930323165 +0000 UTC m=+1973.734680689"
Sep 04 22:41:50.914720 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:41:50.914689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db7fc5975-fsx6v"
Sep 04 22:42:54.975257 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:54.975217    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"]
Sep 04 22:42:54.977738 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:54.975434    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn" podUID="989d45fa-221c-4e42-ba7d-d97a3774db87" containerName="manager" containerID="cri-o://81c349b0a144a0c97c1135f98e23bf4745e3a8195cddd5b95643baa33988e2d7" gracePeriod=10
Sep 04 22:42:55.984377 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:55.984342    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn" podUID="989d45fa-221c-4e42-ba7d-d97a3774db87" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.34:8081/readyz\": dial tcp 10.134.0.34:8081: connect: connection refused"
Sep 04 22:42:56.295627 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.295522    2564 generic.go:356] "Generic (PLEG): container finished" podID="989d45fa-221c-4e42-ba7d-d97a3774db87" containerID="81c349b0a144a0c97c1135f98e23bf4745e3a8195cddd5b95643baa33988e2d7" exitCode=0
Sep 04 22:42:56.295627 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.295592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn" event={"ID":"989d45fa-221c-4e42-ba7d-d97a3774db87","Type":"ContainerDied","Data":"81c349b0a144a0c97c1135f98e23bf4745e3a8195cddd5b95643baa33988e2d7"}
Sep 04 22:42:56.531148 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.531127    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:42:56.677503 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.677473    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/989d45fa-221c-4e42-ba7d-d97a3774db87-extensions-socket-volume\") pod \"989d45fa-221c-4e42-ba7d-d97a3774db87\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") "
Sep 04 22:42:56.677714 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.677515    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rzq4\" (UniqueName: \"kubernetes.io/projected/989d45fa-221c-4e42-ba7d-d97a3774db87-kube-api-access-7rzq4\") pod \"989d45fa-221c-4e42-ba7d-d97a3774db87\" (UID: \"989d45fa-221c-4e42-ba7d-d97a3774db87\") "
Sep 04 22:42:56.677903 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.677879    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989d45fa-221c-4e42-ba7d-d97a3774db87-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "989d45fa-221c-4e42-ba7d-d97a3774db87" (UID: "989d45fa-221c-4e42-ba7d-d97a3774db87"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 04 22:42:56.679887 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.679856    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/989d45fa-221c-4e42-ba7d-d97a3774db87-kube-api-access-7rzq4" (OuterVolumeSpecName: "kube-api-access-7rzq4") pod "989d45fa-221c-4e42-ba7d-d97a3774db87" (UID: "989d45fa-221c-4e42-ba7d-d97a3774db87"). InnerVolumeSpecName "kube-api-access-7rzq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:42:56.778899 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.778872    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/989d45fa-221c-4e42-ba7d-d97a3774db87-extensions-socket-volume\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:42:56.779034 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:56.778901    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rzq4\" (UniqueName: \"kubernetes.io/projected/989d45fa-221c-4e42-ba7d-d97a3774db87-kube-api-access-7rzq4\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:42:57.301910 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:57.301880    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"
Sep 04 22:42:57.302390 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:57.301925    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn" event={"ID":"989d45fa-221c-4e42-ba7d-d97a3774db87","Type":"ContainerDied","Data":"53ef2074d3aca7282ff89d0303b7969d0eac47f6d9c58ade8d37dd43bbffd8af"}
Sep 04 22:42:57.302390 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:57.301994    2564 scope.go:117] "RemoveContainer" containerID="81c349b0a144a0c97c1135f98e23bf4745e3a8195cddd5b95643baa33988e2d7"
Sep 04 22:42:57.325904 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:57.325880    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"]
Sep 04 22:42:57.330912 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:57.330891    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-scnxn"]
Sep 04 22:42:58.670761 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:42:58.670725    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="989d45fa-221c-4e42-ba7d-d97a3774db87" path="/var/lib/kubelet/pods/989d45fa-221c-4e42-ba7d-d97a3774db87/volumes"
Sep 04 22:43:55.646906 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.646867    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"]
Sep 04 22:43:55.647366 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.647267    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989d45fa-221c-4e42-ba7d-d97a3774db87" containerName="manager"
Sep 04 22:43:55.647366 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.647278    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="989d45fa-221c-4e42-ba7d-d97a3774db87" containerName="manager"
Sep 04 22:43:55.647366 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.647351    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="989d45fa-221c-4e42-ba7d-d97a3774db87" containerName="manager"
Sep 04 22:43:55.650477 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.650458    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:55.652770 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.652744    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7pnjv\""
Sep 04 22:43:55.665326 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.665303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"]
Sep 04 22:43:55.803126 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.803090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64408a91-4ace-407f-a5e4-2af9c2dca229-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hrfjk\" (UID: \"64408a91-4ace-407f-a5e4-2af9c2dca229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:55.803304 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.803134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmdv6\" (UniqueName: \"kubernetes.io/projected/64408a91-4ace-407f-a5e4-2af9c2dca229-kube-api-access-vmdv6\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hrfjk\" (UID: \"64408a91-4ace-407f-a5e4-2af9c2dca229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:55.904316 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.904222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64408a91-4ace-407f-a5e4-2af9c2dca229-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hrfjk\" (UID: \"64408a91-4ace-407f-a5e4-2af9c2dca229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:55.904316 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.904269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmdv6\" (UniqueName: \"kubernetes.io/projected/64408a91-4ace-407f-a5e4-2af9c2dca229-kube-api-access-vmdv6\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hrfjk\" (UID: \"64408a91-4ace-407f-a5e4-2af9c2dca229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:55.904680 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.904658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64408a91-4ace-407f-a5e4-2af9c2dca229-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hrfjk\" (UID: \"64408a91-4ace-407f-a5e4-2af9c2dca229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:55.915546 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.915516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmdv6\" (UniqueName: \"kubernetes.io/projected/64408a91-4ace-407f-a5e4-2af9c2dca229-kube-api-access-vmdv6\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-hrfjk\" (UID: \"64408a91-4ace-407f-a5e4-2af9c2dca229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:55.960231 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:55.960196    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:56.242128 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:56.242048    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"]
Sep 04 22:43:56.245732 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:43:56.245700    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64408a91_4ace_407f_a5e4_2af9c2dca229.slice/crio-b8b10ea2b26a2dba35b63b97bc94e1f2b34e80d71c5275284c63f8cc8e27e1b2 WatchSource:0}: Error finding container b8b10ea2b26a2dba35b63b97bc94e1f2b34e80d71c5275284c63f8cc8e27e1b2: Status 404 returned error can't find the container with id b8b10ea2b26a2dba35b63b97bc94e1f2b34e80d71c5275284c63f8cc8e27e1b2
Sep 04 22:43:56.591438 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:56.591402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk" event={"ID":"64408a91-4ace-407f-a5e4-2af9c2dca229","Type":"ContainerStarted","Data":"b8b49b69a60042834d9dae47a59f9a184ab5f3c44b5080620797850b1705631c"}
Sep 04 22:43:56.591648 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:56.591460    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:43:56.591648 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:56.591484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk" event={"ID":"64408a91-4ace-407f-a5e4-2af9c2dca229","Type":"ContainerStarted","Data":"b8b10ea2b26a2dba35b63b97bc94e1f2b34e80d71c5275284c63f8cc8e27e1b2"}
Sep 04 22:43:56.623168 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:43:56.623117    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk" podStartSLOduration=1.623095771 podStartE2EDuration="1.623095771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:43:56.621922538 +0000 UTC m=+2110.426280062" watchObservedRunningTime="2026-09-04 22:43:56.623095771 +0000 UTC m=+2110.427453296"
Sep 04 22:44:07.599413 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:44:07.599377    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-hrfjk"
Sep 04 22:45:39.027274 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.027235    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"]
Sep 04 22:45:39.031497 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.031477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.044053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.044020    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"]
Sep 04 22:45:39.120640 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.120592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51e1885-191c-432e-87f3-6516c7e2b131-maas-api-tls\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.120819 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.120698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51e1885-191c-432e-87f3-6516c7e2b131-openshift-service-ca\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.120819 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.120755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fftl\" (UniqueName: \"kubernetes.io/projected/b51e1885-191c-432e-87f3-6516c7e2b131-kube-api-access-4fftl\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.120819 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.120792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51e1885-191c-432e-87f3-6516c7e2b131-metrics-certs\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.221588 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.221552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51e1885-191c-432e-87f3-6516c7e2b131-maas-api-tls\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.221781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.221650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51e1885-191c-432e-87f3-6516c7e2b131-openshift-service-ca\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.221781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.221694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fftl\" (UniqueName: \"kubernetes.io/projected/b51e1885-191c-432e-87f3-6516c7e2b131-kube-api-access-4fftl\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.221781 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.221739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51e1885-191c-432e-87f3-6516c7e2b131-metrics-certs\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.222411 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.222390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51e1885-191c-432e-87f3-6516c7e2b131-openshift-service-ca\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.224089 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.224060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51e1885-191c-432e-87f3-6516c7e2b131-maas-api-tls\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.224211 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.224097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51e1885-191c-432e-87f3-6516c7e2b131-metrics-certs\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.230678 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.230650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fftl\" (UniqueName: \"kubernetes.io/projected/b51e1885-191c-432e-87f3-6516c7e2b131-kube-api-access-4fftl\") pod \"maas-api-5d9c766c64-hdmd9\" (UID: \"b51e1885-191c-432e-87f3-6516c7e2b131\") " pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.347759 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.347718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:39.630053 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:39.630025    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"]
Sep 04 22:45:39.632132 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:45:39.632102    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51e1885_191c_432e_87f3_6516c7e2b131.slice/crio-2f0ba8684dc41f3ccc8be7b49f31cc321f11ad6d46aaa60a784fd0af40682885 WatchSource:0}: Error finding container 2f0ba8684dc41f3ccc8be7b49f31cc321f11ad6d46aaa60a784fd0af40682885: Status 404 returned error can't find the container with id 2f0ba8684dc41f3ccc8be7b49f31cc321f11ad6d46aaa60a784fd0af40682885
Sep 04 22:45:40.117426 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:40.117388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9" event={"ID":"b51e1885-191c-432e-87f3-6516c7e2b131","Type":"ContainerStarted","Data":"06ffcf18fd688b5d11a0c54f9d8099fbd8a741a2c1b6822c8ec08bbc3420a9e6"}
Sep 04 22:45:40.117787 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:40.117452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9" event={"ID":"b51e1885-191c-432e-87f3-6516c7e2b131","Type":"ContainerStarted","Data":"2f0ba8684dc41f3ccc8be7b49f31cc321f11ad6d46aaa60a784fd0af40682885"}
Sep 04 22:45:40.117787 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:40.117619    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:40.139411 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:40.139338    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9" podStartSLOduration=0.717405175 podStartE2EDuration="1.13932248s" totalImagesPullingTime="421.917305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-04 22:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:45:40.137871558 +0000 UTC m=+2213.942229084" watchObservedRunningTime="2026-09-04 22:45:40.13932248 +0000 UTC m=+2213.943680003"
Sep 04 22:45:46.128710 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:46.128680    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d9c766c64-hdmd9"
Sep 04 22:45:53.499084 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:53.499048    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"]
Sep 04 22:45:53.499521 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:53.499236    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf" podUID="8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" containerName="maas-api" containerID="cri-o://fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873" gracePeriod=30
Sep 04 22:45:54.743982 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.743953    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:45:54.865255 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.865172    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-openshift-service-ca\") pod \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") "
Sep 04 22:45:54.865255 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.865242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-maas-api-tls\") pod \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") "
Sep 04 22:45:54.865478 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.865280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-kube-api-access-2qxw4\") pod \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") "
Sep 04 22:45:54.865478 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.865313    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-metrics-certs\") pod \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\" (UID: \"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86\") "
Sep 04 22:45:54.865633 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.865578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" (UID: "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 04 22:45:54.867546 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.867519    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-kube-api-access-2qxw4" (OuterVolumeSpecName: "kube-api-access-2qxw4") pod "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" (UID: "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86"). InnerVolumeSpecName "kube-api-access-2qxw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 04 22:45:54.867546 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.867539    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" (UID: "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:45:54.867809 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.867789    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" (UID: "8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 04 22:45:54.966544 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.966511    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-openshift-service-ca\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:45:54.966544 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.966539    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-maas-api-tls\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:45:54.966695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.966548    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-kube-api-access-2qxw4\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:45:54.966695 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:54.966574    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86-metrics-certs\") on node \"ip-10-0-139-255.ec2.internal\" DevicePath \"\""
Sep 04 22:45:55.202762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.202666    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" containerID="fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873" exitCode=0
Sep 04 22:45:55.202762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.202706    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"
Sep 04 22:45:55.202940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.202754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf" event={"ID":"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86","Type":"ContainerDied","Data":"fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873"}
Sep 04 22:45:55.202940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.202804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf" event={"ID":"8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86","Type":"ContainerDied","Data":"c0074ff4aa3ac321d553f2f0d55206e754e551a8fca9e25c35435c499dae6077"}
Sep 04 22:45:55.202940 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.202827    2564 scope.go:117] "RemoveContainer" containerID="fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873"
Sep 04 22:45:55.212813 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.212796    2564 scope.go:117] "RemoveContainer" containerID="fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873"
Sep 04 22:45:55.213052 ip-10-0-139-255 kubenswrapper[2564]: E0904 22:45:55.213034    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873\": container with ID starting with fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873 not found: ID does not exist" containerID="fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873"
Sep 04 22:45:55.213105 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.213062    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873"} err="failed to get container status \"fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873\": rpc error: code = NotFound desc = could not find container \"fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873\": container with ID starting with fefd0b06e227f869cdaea8575e9dc3de655e2d4ef9fb15d371901134b10c8873 not found: ID does not exist"
Sep 04 22:45:55.237273 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.237250    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"]
Sep 04 22:45:55.242790 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:55.242769    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d9d77cfb4-kp9zf"]
Sep 04 22:45:56.670814 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:45:56.670775    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" path="/var/lib/kubelet/pods/8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86/volumes"
Sep 04 22:46:14.004199 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:14.004118    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2r9dp_9e7dd329-086c-4588-adaf-5d9f1b494905/manager/0.log"
Sep 04 22:46:14.120927 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:14.120898    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r4qvj_d1ee3d7c-ec05-4cc4-baee-1464d26db8ba/manager/0.log"
Sep 04 22:46:14.236434 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:14.236402    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db7fc5975-fsx6v_6384d6b0-e7dd-48af-bd69-f0f1fc64f576/manager/0.log"
Sep 04 22:46:14.347386 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:14.347363    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wdvm2_1dcead7a-20d4-4afe-b87d-f3524690abf5/server/0.log"
Sep 04 22:46:14.595229 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:14.595202    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd686f5d7-62f5v_82a1b0dc-fbcc-4f9a-908c-1b4d8b832678/copy-manifests/0.log"
Sep 04 22:46:14.602290 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:14.602226    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd686f5d7-62f5v_82a1b0dc-fbcc-4f9a-908c-1b4d8b832678/manager/0.log"
Sep 04 22:46:15.194945 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:15.194911    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d9c766c64-hdmd9_b51e1885-191c-432e-87f3-6516c7e2b131/maas-api/0.log"
Sep 04 22:46:15.635457 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:15.635424    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jd9t5_e9d6bacd-2edf-4a99-be84-e99a957311b1/postgres/0.log"
Sep 04 22:46:16.540726 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:16.540695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-h974l_91479ef6-b425-4732-8235-35632e3e1dbc/manager/0.log"
Sep 04 22:46:16.766167 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:16.766137    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-qn56p_0a7d3a74-980a-477a-bf9d-5972ed8409a4/kuadrant-console-plugin/0.log"
Sep 04 22:46:16.889100 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:16.889072    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-hrfjk_64408a91-4ace-407f-a5e4-2af9c2dca229/manager/0.log"
Sep 04 22:46:17.467925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:17.467897    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799crkv54_8bf7d554-9ff6-450f-a26d-7e4b6f085774/istio-proxy/0.log"
Sep 04 22:46:17.690284 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:17.690249    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7766956b67-gctsx_6b486dbd-39a5-45f5-b939-8ed4dc1894d6/kube-auth-proxy/0.log"
Sep 04 22:46:17.939314 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:17.939282    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-k9dfx_cd5acc36-1427-41ce-a8e3-935a99102710/istio-proxy/1.log"
Sep 04 22:46:18.051163 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:18.051131    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9f952_2be6867d-d712-4e19-b490-a0b7353ba6c0/payload-pre-processing/0.log"
Sep 04 22:46:18.618766 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:18.618728    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rdwg6_902f9e41-8e00-46a3-99c6-2497e832bcd8/main/0.log"
Sep 04 22:46:18.953853 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:18.953778    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vg794_8494ce7b-8b97-455c-ab2c-14e7a067774b/main/0.log"
Sep 04 22:46:19.176185 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:19.176154    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dv7fk_ba339f24-58c5-49c2-9a71-80c0bfd69587/main/0.log"
Sep 04 22:46:27.525616 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:27.525577    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zt747_9ad471ec-b404-491c-81d9-b5fa38c02d44/global-pull-secret-syncer/0.log"
Sep 04 22:46:27.656431 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:27.656405    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-srkj2_313f3fe7-3563-45df-8985-2dc4e9f73132/konnectivity-agent/0.log"
Sep 04 22:46:27.729750 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:27.729723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-255.ec2.internal_ee8043870e702042f063468f7cb1ab5f/haproxy/0.log"
Sep 04 22:46:32.394872 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:32.394837    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-h974l_91479ef6-b425-4732-8235-35632e3e1dbc/manager/0.log"
Sep 04 22:46:32.470059 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:32.470031    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-qn56p_0a7d3a74-980a-477a-bf9d-5972ed8409a4/kuadrant-console-plugin/0.log"
Sep 04 22:46:32.515777 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:32.515755    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-hrfjk_64408a91-4ace-407f-a5e4-2af9c2dca229/manager/0.log"
Sep 04 22:46:34.495558 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:34.495529    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mw8q4_85a6c08e-6b16-4e59-8c18-cd9b6decb1ee/kube-state-metrics/0.log"
Sep 04 22:46:34.525360 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:34.525314    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mw8q4_85a6c08e-6b16-4e59-8c18-cd9b6decb1ee/kube-rbac-proxy-main/0.log"
Sep 04 22:46:34.548967 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:34.548940    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mw8q4_85a6c08e-6b16-4e59-8c18-cd9b6decb1ee/kube-rbac-proxy-self/0.log"
Sep 04 22:46:34.847870 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:34.847844    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tth9d_3686e0c1-4b82-4a64-b017-5c8fae1f09b4/node-exporter/0.log"
Sep 04 22:46:34.879535 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:34.879508    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tth9d_3686e0c1-4b82-4a64-b017-5c8fae1f09b4/kube-rbac-proxy/0.log"
Sep 04 22:46:34.906473 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:34.906449    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tth9d_3686e0c1-4b82-4a64-b017-5c8fae1f09b4/init-textfile/0.log"
Sep 04 22:46:35.249441 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:35.249361    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-ppgd5_80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7/prometheus-operator/0.log"
Sep 04 22:46:35.276526 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:35.276498    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-ppgd5_80e7b4b3-c59d-41c4-ad20-fc03fe6aacf7/kube-rbac-proxy/0.log"
Sep 04 22:46:37.662979 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.662946    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"]
Sep 04 22:46:37.663404 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.663382    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" containerName="maas-api"
Sep 04 22:46:37.663404 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.663396    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" containerName="maas-api"
Sep 04 22:46:37.663542 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.663465    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad2ceb3-bc4e-4aad-94a9-8bf3528fec86" containerName="maas-api"
Sep 04 22:46:37.666762 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.666736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.668902 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.668879    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2c9z6\"/\"default-dockercfg-6c2zj\""
Sep 04 22:46:37.668996 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.668982    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2c9z6\"/\"kube-root-ca.crt\""
Sep 04 22:46:37.669671 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.669650    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2c9z6\"/\"openshift-service-ca.crt\""
Sep 04 22:46:37.676269 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.676247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"]
Sep 04 22:46:37.748387 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.748354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-lib-modules\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.748553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.748457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-podres\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.748553 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.748497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-proc\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.748670 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.748583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-sys\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.748715 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.748671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpblg\" (UniqueName: \"kubernetes.io/projected/af676da6-81b2-4ac7-b285-838075bfe507-kube-api-access-qpblg\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.849913 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.849877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-lib-modules\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850047 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.849935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-podres\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850047 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.849972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-proc\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850047 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.850011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-sys\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.850050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpblg\" (UniqueName: \"kubernetes.io/projected/af676da6-81b2-4ac7-b285-838075bfe507-kube-api-access-qpblg\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.850071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-lib-modules\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.850095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-proc\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.850121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-sys\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.850249 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.850125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af676da6-81b2-4ac7-b285-838075bfe507-podres\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.858794 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.858773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpblg\" (UniqueName: \"kubernetes.io/projected/af676da6-81b2-4ac7-b285-838075bfe507-kube-api-access-qpblg\") pod \"perf-node-gather-daemonset-z7hts\" (UID: \"af676da6-81b2-4ac7-b285-838075bfe507\") " pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:37.977857 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:37.977766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:38.221638 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:38.221590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-pv8w5_39a362d4-d9d3-4a34-a49b-2040e48c18c7/download-server/0.log"
Sep 04 22:46:38.248359 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:38.248335    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"]
Sep 04 22:46:38.250563 ip-10-0-139-255 kubenswrapper[2564]: W0904 22:46:38.250529    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaf676da6_81b2_4ac7_b285_838075bfe507.slice/crio-b9669481eb4eca611054697377c81a26cc4d26039a7a53dc8a0a3450149795a9 WatchSource:0}: Error finding container b9669481eb4eca611054697377c81a26cc4d26039a7a53dc8a0a3450149795a9: Status 404 returned error can't find the container with id b9669481eb4eca611054697377c81a26cc4d26039a7a53dc8a0a3450149795a9
Sep 04 22:46:38.426933 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:38.426895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts" event={"ID":"af676da6-81b2-4ac7-b285-838075bfe507","Type":"ContainerStarted","Data":"e694dede5dc2ffe6eb9590a962e59de7e74a587d97b534598f19fbfe33436710"}
Sep 04 22:46:38.427081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:38.426950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts" event={"ID":"af676da6-81b2-4ac7-b285-838075bfe507","Type":"ContainerStarted","Data":"b9669481eb4eca611054697377c81a26cc4d26039a7a53dc8a0a3450149795a9"}
Sep 04 22:46:38.427081 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:38.427007    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:38.443235 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:38.443190    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts" podStartSLOduration=1.443176387 podStartE2EDuration="1.443176387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-04 22:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-04 22:46:38.441909121 +0000 UTC m=+2272.246266645" watchObservedRunningTime="2026-09-04 22:46:38.443176387 +0000 UTC m=+2272.247533931"
Sep 04 22:46:38.927543 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:38.927507    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-2cvvv_27efcf9b-413a-4f08-b5b0-f898cd6ed2c8/volume-data-source-validator/0.log"
Sep 04 22:46:40.174739 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:40.174704    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2wsr_365fa8d5-afda-473a-ae2c-9fdf8e16313b/dns/0.log"
Sep 04 22:46:40.197983 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:40.197959    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2wsr_365fa8d5-afda-473a-ae2c-9fdf8e16313b/kube-rbac-proxy/0.log"
Sep 04 22:46:40.252808 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:40.252781    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ngj8_55666064-c8a5-4d05-9b9c-b255bc3b0d4a/dns-node-resolver/0.log"
Sep 04 22:46:40.841925 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:40.841893    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7765ddb8dd-cpng4_4c202b06-f1b8-4708-8247-2b11afb29a88/registry/0.log"
Sep 04 22:46:40.892176 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:40.892145    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-drdhf_0fcb5d90-7077-4d96-aa70-ff55659d199b/node-ca/0.log"
Sep 04 22:46:41.883728 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:41.883693    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799crkv54_8bf7d554-9ff6-450f-a26d-7e4b6f085774/istio-proxy/0.log"
Sep 04 22:46:42.196334 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:42.196254    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7766956b67-gctsx_6b486dbd-39a5-45f5-b939-8ed4dc1894d6/kube-auth-proxy/0.log"
Sep 04 22:46:42.255221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:42.255192    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-k9dfx_cd5acc36-1427-41ce-a8e3-935a99102710/istio-proxy/0.log"
Sep 04 22:46:42.264349 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:42.264321    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-k9dfx_cd5acc36-1427-41ce-a8e3-935a99102710/istio-proxy/1.log"
Sep 04 22:46:42.298271 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:42.298235    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9f952_2be6867d-d712-4e19-b490-a0b7353ba6c0/payload-pre-processing/0.log"
Sep 04 22:46:43.319451 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:43.319420    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9752r_5e18588a-0b92-41dd-ba69-4ec8ac138d4b/serve-healthcheck-canary/0.log"
Sep 04 22:46:44.070735 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:44.070706    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-plhrr_91c83992-9df0-4630-b125-0ad6c9166b44/kube-rbac-proxy/0.log"
Sep 04 22:46:44.096221 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:44.096195    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-plhrr_91c83992-9df0-4630-b125-0ad6c9166b44/exporter/0.log"
Sep 04 22:46:44.121916 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:44.121894    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-plhrr_91c83992-9df0-4630-b125-0ad6c9166b44/extractor/0.log"
Sep 04 22:46:44.443320 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:44.443249    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2c9z6/perf-node-gather-daemonset-z7hts"
Sep 04 22:46:46.367583 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:46.367545    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2r9dp_9e7dd329-086c-4588-adaf-5d9f1b494905/manager/0.log"
Sep 04 22:46:46.571245 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:46.571168    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r4qvj_d1ee3d7c-ec05-4cc4-baee-1464d26db8ba/manager/0.log"
Sep 04 22:46:46.616429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:46.616397    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db7fc5975-fsx6v_6384d6b0-e7dd-48af-bd69-f0f1fc64f576/manager/0.log"
Sep 04 22:46:46.646748 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:46.646728    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wdvm2_1dcead7a-20d4-4afe-b87d-f3524690abf5/server/0.log"
Sep 04 22:46:46.777880 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:46.777850    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd686f5d7-62f5v_82a1b0dc-fbcc-4f9a-908c-1b4d8b832678/manager/0.log"
Sep 04 22:46:46.803676 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:46.803650    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd686f5d7-62f5v_82a1b0dc-fbcc-4f9a-908c-1b4d8b832678/copy-manifests/0.log"
Sep 04 22:46:48.531679 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:48.531650    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799crkv54_8bf7d554-9ff6-450f-a26d-7e4b6f085774/istio-proxy/0.log"
Sep 04 22:46:48.834720 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:48.834687    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7766956b67-gctsx_6b486dbd-39a5-45f5-b939-8ed4dc1894d6/kube-auth-proxy/0.log"
Sep 04 22:46:48.878034 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:48.878002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-k9dfx_cd5acc36-1427-41ce-a8e3-935a99102710/istio-proxy/0.log"
Sep 04 22:46:48.886727 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:48.886702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-k9dfx_cd5acc36-1427-41ce-a8e3-935a99102710/istio-proxy/1.log"
Sep 04 22:46:48.910318 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:48.910293    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9f952_2be6867d-d712-4e19-b490-a0b7353ba6c0/payload-pre-processing/0.log"
Sep 04 22:46:50.421616 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:50.421577    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799crkv54_8bf7d554-9ff6-450f-a26d-7e4b6f085774/istio-proxy/0.log"
Sep 04 22:46:50.734725 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:50.734616    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7766956b67-gctsx_6b486dbd-39a5-45f5-b939-8ed4dc1894d6/kube-auth-proxy/0.log"
Sep 04 22:46:50.773668 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:50.773638    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-k9dfx_cd5acc36-1427-41ce-a8e3-935a99102710/istio-proxy/0.log"
Sep 04 22:46:50.782487 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:50.782456    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-k9dfx_cd5acc36-1427-41ce-a8e3-935a99102710/istio-proxy/1.log"
Sep 04 22:46:50.805293 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:50.805266    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9f952_2be6867d-d712-4e19-b490-a0b7353ba6c0/payload-pre-processing/0.log"
Sep 04 22:46:53.796365 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:53.796317    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-h56wv_8debe23c-27d9-41cb-b13a-e7f00f98fa28/migrator/0.log"
Sep 04 22:46:53.820273 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:53.820243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-h56wv_8debe23c-27d9-41cb-b13a-e7f00f98fa28/graceful-termination/0.log"
Sep 04 22:46:54.215656 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:54.215624    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-7zl8s_e5a791a7-0a61-4501-b0c5-3789ffca6261/kube-storage-version-migrator-operator/1.log"
Sep 04 22:46:54.216529 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:54.216509    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-7zl8s_e5a791a7-0a61-4501-b0c5-3789ffca6261/kube-storage-version-migrator-operator/0.log"
Sep 04 22:46:55.505714 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:55.505683    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwpx_e0c78e1d-3a62-4d8e-b8a0-a6c673966222/kube-multus-additional-cni-plugins/0.log"
Sep 04 22:46:55.530206 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:55.530178    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwpx_e0c78e1d-3a62-4d8e-b8a0-a6c673966222/egress-router-binary-copy/0.log"
Sep 04 22:46:55.554523 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:55.554500    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwpx_e0c78e1d-3a62-4d8e-b8a0-a6c673966222/cni-plugins/0.log"
Sep 04 22:46:55.579861 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:55.579835    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwpx_e0c78e1d-3a62-4d8e-b8a0-a6c673966222/bond-cni-plugin/0.log"
Sep 04 22:46:55.604429 ip-10-0-139-255 kubenswrapper[2564]: I0904 22:46:55.604407    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwpx_e0c78e1d-3a62-4d8e-b8a0-a6c673966222/routeoverride-cni/0.log"