Sep 10 12:30:08.768480 ip-10-0-130-88 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 12:30:09.194682 ip-10-0-130-88 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 12:30:09.194682 ip-10-0-130-88 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 12:30:09.194682 ip-10-0-130-88 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 12:30:09.194682 ip-10-0-130-88 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 12:30:09.194682 ip-10-0-130-88 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 12:30:09.195670 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.195583    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 12:30:09.199670 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199655    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:30:09.199670 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199670    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199674    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199677    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199681    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199684    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199687    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199690    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199693    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199695    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199699    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199701    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199704    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199707    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199709    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199713    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199718    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199720    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199723    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199726    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199729    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:30:09.199740 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199731    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199734    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199737    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199739    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199742    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199746    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199748    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199751    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199754    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199757    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199759    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199761    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199764    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199767    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199770    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199772    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199774    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199777    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199779    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199783    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:30:09.200286 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199788    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199791    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199794    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199796    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199799    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199802    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199804    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199807    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199810    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199812    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199814    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199820    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199823    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199826    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199830    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199832    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199835    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199838    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199841    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:30:09.200777 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199844    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199846    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199849    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199851    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199854    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199857    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199859    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199862    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199864    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199867    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199869    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199872    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199874    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199877    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199887    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199890    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199892    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199895    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199898    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199900    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:30:09.201263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199903    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199907    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199909    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199912    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199914    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199916    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199920    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199923    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199926    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199928    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199931    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199934    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199936    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199939    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199941    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199943    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199946    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199949    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.199951    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:30:09.201748 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200691    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200697    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200701    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200703    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200706    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200708    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200711    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200713    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200719    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200723    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200726    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200729    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200732    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200735    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200738    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200740    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200743    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200746    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200749    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200752    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:30:09.202206 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200756    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200759    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200762    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200765    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200768    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200771    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200773    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200776    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200779    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200782    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200785    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200787    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200790    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200792    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200795    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200797    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200800    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200802    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200805    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200807    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:30:09.202720 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200810    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200813    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200816    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200818    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200821    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200825    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200828    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200830    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200834    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200838    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200842    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200845    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200848    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200851    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200854    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200856    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200859    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200862    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200864    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:30:09.203228 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200866    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200869    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200871    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200874    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200876    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200878    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200881    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200883    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200885    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200888    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200891    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200893    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200895    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200898    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200901    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200903    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200906    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200908    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200911    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200913    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:30:09.203702 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200916    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200918    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200921    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200923    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200926    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200929    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200931    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200934    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200936    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200939    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200941    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200944    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200946    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200949    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200951    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200954    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200956    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200958    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200961    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.200963    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:30:09.204242 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201388    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201395    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201398    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201401    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201403    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201406    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201409    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201416    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201418    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201421    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201424    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201426    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201429    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201431    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201434    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201437    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201439    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201442    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201445    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201447    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:30:09.204726 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201450    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201452    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201455    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201457    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201460    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201462    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201465    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201468    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201472    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201475    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201478    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201480    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201483    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201486    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201488    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201491    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201493    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201496    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201498    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:30:09.205261 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201502    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201505    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201508    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201510    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201512    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201515    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201517    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201520    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201522    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201525    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201528    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201530    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201533    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201535    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201538    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201541    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201544    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201546    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201548    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:30:09.205728 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201551    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201553    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201555    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201558    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201560    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201563    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201565    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201567    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201571    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201574    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201576    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201578    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201581    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201585    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201587    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201590    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201592    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201595    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201597    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201599    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:30:09.206182 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201602    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201604    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201607    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201610    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201612    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201615    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201617    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201620    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201623    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201626    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201628    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201631    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201633    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201636    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201638    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201640    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201643    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201646    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201650    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:30:09.206704 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201653    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.201655    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201722    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201758    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201764    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201768    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201774    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201777    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201780    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201785    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201788    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201791    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201795    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201798    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201801    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201804    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201818    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201822    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201825    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201828    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201833    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201835    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201839    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201842    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 12:30:09.207166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201845    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201849    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201852    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201855    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201858    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201861    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201864    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201867    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201870    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201873    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201877    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201880    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201883    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201886    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201890    2565 flags.go:64] FLAG: --enable-server="true"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201893    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201897    2565 flags.go:64] FLAG: --event-burst="100"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201900    2565 flags.go:64] FLAG: --event-qps="50"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201903    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201907    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201909    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201913    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201915    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201918    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201921    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 10 12:30:09.207787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201924    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201927    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201930    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201933    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201936    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201939    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201941    2565 flags.go:64] FLAG: --feature-gates=""
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201945    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201947    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201950    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201953    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201956    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201959    2565 flags.go:64] FLAG: --help="false"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201962    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201965    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201968    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201971    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201974    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201977    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201980    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201983    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201987    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201989    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 12:30:09.208469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201992    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.201999    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202002    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202006    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202008    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202011    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202014    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202017    2565 flags.go:64] FLAG: --lock-file=""
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202021    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202024    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202027    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202032    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202035    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202038    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202040    2565 flags.go:64] FLAG: --logging-format="text"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202043    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202046    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202049    2565 flags.go:64] FLAG: --manifest-url=""
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202052    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202056    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202059    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202063    2565 flags.go:64] FLAG: --max-pods="110"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202066    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202069    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202072    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 12:30:09.209039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202075    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202078    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202080    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202083    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202090    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202095    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202098    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202101    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202104    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202109    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202112    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202115    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202118    2565 flags.go:64] FLAG: --port="10250"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202121    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202124    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cafbf6c9737152ae"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202127    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202134    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202139    2565 flags.go:64] FLAG: --register-node="true"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202143    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202147    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202150    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202153    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202156    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202159    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202162    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 12:30:09.209731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202165    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202168    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202171    2565 flags.go:64] FLAG: --runonce="false"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202174    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202177    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202180    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202183    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202186    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202189    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202192    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202195    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202198    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202202    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202205    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202221    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202224    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202227    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202230    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202236    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202240    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202242    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202247    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202250    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202254    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202257    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 12:30:09.210621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202259    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202262    2565 flags.go:64] FLAG: --v="2"
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202266    2565 flags.go:64] FLAG: --version="false"
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202271    2565 flags.go:64] FLAG: --vmodule=""
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202275    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.202278    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202397    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202401    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202404    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202407    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202410    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202413    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202416    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202419    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202422    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202425    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202427    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202430    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202433    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202437    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202440    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:30:09.211454 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202443    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202445    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202448    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202452    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202454    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202457    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202460    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202463    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202465    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202469    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202471    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202474    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202476    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202479    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202482    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202485    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202487    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202490    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202492    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202495    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:30:09.212138 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202497    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202500    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202502    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202505    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202507    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202510    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202512    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202515    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202517    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202520    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202523    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202525    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202528    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202531    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202533    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202536    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202538    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202541    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202543    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:30:09.212712 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202546    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202549    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202553    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202555    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202558    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202561    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202563    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202566    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202568    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202571    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202575    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202578    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202581    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202584    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202587    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202589    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202592    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202595    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202598    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202600    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:30:09.213255 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202603    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202605    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202608    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202610    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202613    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202615    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202618    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202620    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202623    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202625    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202629    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202633    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202638    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202643    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202649    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202652    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202654    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202658    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202660    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:30:09.213808 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202663    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202666    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202668    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202671    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202674    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.202676    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.203312    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.212292    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.212307    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.212321    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.212327    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212399    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212404    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212408    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212411    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:30:09.214339 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212414    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212417    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212420    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212422    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212425    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212428    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212431    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212434    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212436    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212439    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212442    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212444    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212447    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212449    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212452    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212454    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212458    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212460    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212463    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212465    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:30:09.214771 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212469    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212472    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212475    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212477    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212480    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212482    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212485    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212487    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212490    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212492    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212495    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212497    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212499    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212502    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212504    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212507    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212509    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212513    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212517    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212519    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:30:09.215285 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212522    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212525    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212528    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212530    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212533    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212535    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212538    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212540    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212546    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212548    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212551    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212553    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212556    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212559    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212561    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212563    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212566    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212568    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212571    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:30:09.215760 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212573    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212576    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212578    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212581    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212583    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212586    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212588    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212591    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212593    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212596    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212598    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212601    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212603    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212606    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212608    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212611    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212613    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212616    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212618    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:30:09.216263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212621    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212624    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212626    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212628    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212631    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212633    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212636    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212638    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212641    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212643    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212646    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212648    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212650    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212654    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212658    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:30:09.216730 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212662    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.212667    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212779    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212784    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212787    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212790    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212793    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212795    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212798    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212801    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212803    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212806    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212809    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212811    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212814    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:30:09.217097 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212817    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212820    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212822    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212825    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212828    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212830    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212833    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212835    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212837    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212840    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212843    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212845    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212848    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212850    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212852    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212855    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212858    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212860    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212863    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212865    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:30:09.217561 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212868    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212870    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212873    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212875    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212878    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212880    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212883    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212885    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212888    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212890    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212893    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212895    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212898    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212901    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212903    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212906    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212909    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212911    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212913    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:30:09.218049 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212916    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212918    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212921    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212923    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212926    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212928    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212930    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212933    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212935    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212939    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212943    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212946    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212949    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212952    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212954    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212957    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212959    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212961    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212964    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:30:09.218517 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212966    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212969    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212971    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212973    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212976    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212978    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212981    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212984    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212986    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212989    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212991    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212995    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.212998    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213001    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213005    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213008    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213011    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213014    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213017    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:30:09.218955 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213020    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213022    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213025    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213028    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213030    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213033    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213036    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213038    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:09.213040    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.213045    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.214888    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 12:30:09.219448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.219192    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 12:30:09.220317 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.220305    2565 server.go:1019] "Starting client certificate rotation"
Sep 10 12:30:09.220430 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.220412    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 12:30:09.220463 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.220449    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 12:30:09.223175 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.223162    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 12:30:09.224366 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.224349    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 12:30:09.236774 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.236753    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 10 12:30:09.240764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.240746    2565 log.go:25] "Validated CRI v1 image API"
Sep 10 12:30:09.243396 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.243381    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 12:30:09.248375 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.248357    2565 fs.go:135] Filesystem UUIDs: map[74e68006-d6a8-4cb9-9b4d-671335af3ce2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e08eddf3-7f77-4b17-991d-ea5c02c5f542:/dev/nvme0n1p3]
Sep 10 12:30:09.248427 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.248374    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 12:30:09.251403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.251383    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 12:30:09.255459 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.255345    2565 manager.go:216] Machine: {Timestamp:2026-09-10 12:30:09.25391464 +0000 UTC m=+0.374269208 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100106 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29ffa9e0f07fe8bde65879f2623f9c SystemUUID:ec29ffa9-e0f0-7fe8-bde6-5879f2623f9c BootID:8b8ad1da-2e39-4f3a-bc4d-7678882e34a8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9f:70:64:f4:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9f:70:64:f4:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:64:57:62:d5:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 12:30:09.255459 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.255455    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 12:30:09.255614 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.255541    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 12:30:09.259383 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.259360    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 12:30:09.259515 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.259386    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-88.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 12:30:09.260948 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.260938    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 12:30:09.260986 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.260952    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 12:30:09.260986 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.260961    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 12:30:09.261783 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.261773    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 12:30:09.263003 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.262993    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 12:30:09.267510 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.267498    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 12:30:09.267628 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.267618    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 12:30:09.267659 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.267649    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 12:30:09.267690 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.267662    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 12:30:09.267690 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.267687    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 12:30:09.267743 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.267701    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 10 12:30:09.267743 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.267712    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 12:30:09.268074 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.268056    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 12:30:09.268124 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.268081    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 12:30:09.270448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.270432    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 12:30:09.272773 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.272758    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 12:30:09.272839 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.272789    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 12:30:09.273516 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273504    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 12:30:09.273575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273519    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 12:30:09.273575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273526    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 12:30:09.273575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273531    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 12:30:09.273575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273539    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 12:30:09.273575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273544    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 12:30:09.273714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273655    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 12:30:09.273714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273661    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 12:30:09.273714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273667    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 12:30:09.273714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273672    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 12:30:09.273714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273688    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 12:30:09.273714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.273696    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 12:30:09.275476 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.275464    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 12:30:09.275512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.275477    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 12:30:09.277841 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.277816    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 12:30:09.277841 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.277818    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 12:30:09.279491 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.279479    2565 server.go:1268] "Started kubelet"
Sep 10 12:30:09.279597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.279571    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 12:30:09.279700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.279651    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 12:30:09.279741 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.279725    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 12:30:09.280949 ip-10-0-130-88 systemd[1]: Started Kubernetes Kubelet.
Sep 10 12:30:09.281251 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.281232    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 12:30:09.283233 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.283191    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 12:30:09.285578 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.285559    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 12:30:09.288272 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.288257    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-88.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 12:30:09.288885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.288867    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 12:30:09.288965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.288871    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 12:30:09.289024 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.289000    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.289255 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.288106    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-88.ec2.internal.18d3f58081db0131  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-88.ec2.internal,UID:ip-10-0-130-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-88.ec2.internal,},FirstTimestamp:2026-09-10 12:30:09.279451441 +0000 UTC m=+0.399806009,LastTimestamp:2026-09-10 12:30:09.279451441 +0000 UTC m=+0.399806009,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-88.ec2.internal,}"
Sep 10 12:30:09.289669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.289651    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 12:30:09.289669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.289668    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 12:30:09.289669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.289650    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 12:30:09.289814 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.289751    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 12:30:09.289814 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.289762    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 12:30:09.291156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.291138    2565 factory.go:55] Registering systemd factory
Sep 10 12:30:09.291156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.291160    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 10 12:30:09.292358 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.292342    2565 factory.go:153] Registering CRI-O factory
Sep 10 12:30:09.292358 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.292360    2565 factory.go:223] Registration of the crio container factory successfully
Sep 10 12:30:09.292471 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.292425    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 12:30:09.292471 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.292443    2565 factory.go:103] Registering Raw factory
Sep 10 12:30:09.292571 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.292479    2565 manager.go:1196] Started watching for new ooms in manager
Sep 10 12:30:09.292924 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.292902    2565 manager.go:349] Starting recovery of all containers
Sep 10 12:30:09.295010 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.294980    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 12:30:09.295113 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.295091    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 12:30:09.304876 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.304860    2565 manager.go:354] Recovery completed
Sep 10 12:30:09.304958 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.304901    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9768r"
Sep 10 12:30:09.308943 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.308931    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:30:09.312898 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.312883    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9768r"
Sep 10 12:30:09.314426 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.314406    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:30:09.314529 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.314452    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:30:09.314529 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.314465    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:30:09.315081 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.315063    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 12:30:09.315162 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.315082    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 12:30:09.315162 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.315100    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 12:30:09.315162 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.315083    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:30:09.316104 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.316085    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:30:09.316171 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.316119    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:30:09.316171 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.316131    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:30:09.316256 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.316016    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-88.ec2.internal.18d3f58083f0cb92  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-88.ec2.internal,UID:ip-10-0-130-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-88.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-88.ec2.internal,},FirstTimestamp:2026-09-10 12:30:09.314433938 +0000 UTC m=+0.434788510,LastTimestamp:2026-09-10 12:30:09.314433938 +0000 UTC m=+0.434788510,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-88.ec2.internal,}"
Sep 10 12:30:09.317273 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.317262    2565 policy_none.go:49] "None policy: Start"
Sep 10 12:30:09.317321 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.317278    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 12:30:09.317321 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.317288    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 12:30:09.319177 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.319165    2565 policy_none.go:47] "Start"
Sep 10 12:30:09.349931 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.349764    2565 manager.go:337] "Starting Device Plugin manager"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.349945    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.349959    2565 server.go:87] "Starting device plugin registration server"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.350174    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.350185    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.350274    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.350385    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.350396    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.351000    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 12:30:09.372645 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.351041    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.387107 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.387078    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 12:30:09.388534 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.388518    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 12:30:09.388598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.388567    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 12:30:09.388598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.388588    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 12:30:09.388668 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.388634    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 12:30:09.390798 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.390776    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:30:09.450764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.450677    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:30:09.451680 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.451661    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:30:09.451776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.451690    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:30:09.451776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.451706    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:30:09.451776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.451728    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.458420 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.458402    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.458525 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.458430    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-88.ec2.internal\": node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.487986 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.487956    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.488908 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.488882    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal"]
Sep 10 12:30:09.488993 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.488982    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:30:09.489947 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.489929    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:30:09.490068 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.489959    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:30:09.490068 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.489970    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:30:09.490068 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.490025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09bebac2525c04851abfa6332afa10ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal\" (UID: \"09bebac2525c04851abfa6332afa10ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.490179 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.490058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09bebac2525c04851abfa6332afa10ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal\" (UID: \"09bebac2525c04851abfa6332afa10ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.492428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.492415    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:30:09.492588 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.492575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.492630 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.492615    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:30:09.493277 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.493257    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:30:09.493360 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.493281    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:30:09.493360 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.493292    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:30:09.493360 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.493307    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:30:09.493360 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.493317    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:30:09.493360 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.493332    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:30:09.495657 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.495641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.495742 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.495670    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:30:09.496474 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.496456    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:30:09.496474 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.496475    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:30:09.496594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.496485    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:30:09.522943 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.522920    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-88.ec2.internal\" not found" node="ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.527328 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.527312    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-88.ec2.internal\" not found" node="ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.588722 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.588690    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.590930 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.590913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09bebac2525c04851abfa6332afa10ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal\" (UID: \"09bebac2525c04851abfa6332afa10ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.590993 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.590938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09bebac2525c04851abfa6332afa10ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal\" (UID: \"09bebac2525c04851abfa6332afa10ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.590993 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.590960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ec8bd4921b9fbbb4ef0d7416c6238f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-88.ec2.internal\" (UID: \"1ec8bd4921b9fbbb4ef0d7416c6238f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.591059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.591001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09bebac2525c04851abfa6332afa10ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal\" (UID: \"09bebac2525c04851abfa6332afa10ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.591059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.591017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09bebac2525c04851abfa6332afa10ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal\" (UID: \"09bebac2525c04851abfa6332afa10ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.689134 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.689103    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.691275 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.691259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ec8bd4921b9fbbb4ef0d7416c6238f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-88.ec2.internal\" (UID: \"1ec8bd4921b9fbbb4ef0d7416c6238f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.691321 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.691306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ec8bd4921b9fbbb4ef0d7416c6238f1-config\") pod \"kube-apiserver-proxy-ip-10-0-130-88.ec2.internal\" (UID: \"1ec8bd4921b9fbbb4ef0d7416c6238f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.789761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.789689    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.825016 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.824992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.830972 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:09.830948    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:09.890792 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.890758    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:09.991275 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:09.991233    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:10.091761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:10.091686    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:10.192234 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:10.192182    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-88.ec2.internal\" not found"
Sep 10 12:30:10.220542 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.220511    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 12:30:10.221020 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.220707    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 12:30:10.277663 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.277632    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:30:10.289024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.288998    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:10.289122 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.289024    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 12:30:10.303379 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.303355    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 12:30:10.307286 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.307272    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 12:30:10.308724 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.308711    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal"
Sep 10 12:30:10.318772 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.318743    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:25:09 +0000 UTC" deadline="2028-05-06 10:58:22.638164303 +0000 UTC"
Sep 10 12:30:10.318772 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.318770    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14494h28m12.319399228s"
Sep 10 12:30:10.319105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.319093    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 12:30:10.327069 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.327048    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qccqx"
Sep 10 12:30:10.336205 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.336183    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qccqx"
Sep 10 12:30:10.519375 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.519340    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:30:10.530395 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:10.530365    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec8bd4921b9fbbb4ef0d7416c6238f1.slice/crio-2a50613e364d9019ff511e737b8e64425f7baf493441a1a861157b71d4e56493 WatchSource:0}: Error finding container 2a50613e364d9019ff511e737b8e64425f7baf493441a1a861157b71d4e56493: Status 404 returned error can't find the container with id 2a50613e364d9019ff511e737b8e64425f7baf493441a1a861157b71d4e56493
Sep 10 12:30:10.530654 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:10.530623    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09bebac2525c04851abfa6332afa10ea.slice/crio-001bf92ed97d32d576cd3c35d0998c74b2514ed37437b042f5ecac781e76ffe1 WatchSource:0}: Error finding container 001bf92ed97d32d576cd3c35d0998c74b2514ed37437b042f5ecac781e76ffe1: Status 404 returned error can't find the container with id 001bf92ed97d32d576cd3c35d0998c74b2514ed37437b042f5ecac781e76ffe1
Sep 10 12:30:10.534407 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.534392    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:30:10.790566 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:10.790536    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:30:11.269105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.269064    2565 apiserver.go:52] "Watching apiserver"
Sep 10 12:30:11.278921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.278753    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 12:30:11.279930 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.279893    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rnjkw","kube-system/konnectivity-agent-sksv5","openshift-dns/node-resolver-54nhs","openshift-network-diagnostics/network-check-target-ggg7m","openshift-network-operator/iptables-alerter-f25p6","openshift-ovn-kubernetes/ovnkube-node-6mhg7","kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4","openshift-cluster-node-tuning-operator/tuned-k7lp2","openshift-image-registry/node-ca-7nwfn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal","openshift-multus/multus-additional-cni-plugins-4nxmq","openshift-multus/multus-mb7ks","openshift-multus/network-metrics-daemon-8lpqz"]
Sep 10 12:30:11.282849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.282827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.282981 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.282911    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:11.285005 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.284978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.287577 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.287385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.287577 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.287475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 12:30:11.292383 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.292357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:11.292489 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.292448    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:11.292778 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.292751    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zgr22\""
Sep 10 12:30:11.293071 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.293053    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 12:30:11.294028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.293477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.294028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.293620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k5h6l\""
Sep 10 12:30:11.294028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.293832    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 12:30:11.294269 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.294111    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 12:30:11.295638 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.295615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.296778 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.296757    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:30:11.296948 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.296926    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bjsg6\""
Sep 10 12:30:11.297060 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.296999    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 12:30:11.297863 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.297687    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 12:30:11.298388 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.298366    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 12:30:11.298597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.298579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.298830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.298966    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.298838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d8dbaa-f07e-413b-b890-2e2d1558c504-tmp-dir\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299092    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df585ff6-5e22-412d-b178-6dae865581a6-host-slash\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-systemd-units\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-env-overrides\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.299240 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33642adc-8123-442f-a633-07cc3f6d2318-ovn-node-metrics-cert\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.299788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-ovnkube-script-lib\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.299788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-cni-bin\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.299788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33d8dbaa-f07e-413b-b890-2e2d1558c504-hosts-file\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.299788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-var-lib-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.299788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-log-socket\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.299788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.300049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qr8pc\""
Sep 10 12:30:11.300049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.299995    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 12:30:11.300049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300024    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 12:30:11.300370 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-etc-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300370 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df585ff6-5e22-412d-b178-6dae865581a6-iptables-alerter-script\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.300552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/669814f0-ac4f-4c5a-8070-820e7ff46462-agent-certs\") pod \"konnectivity-agent-sksv5\" (UID: \"669814f0-ac4f-4c5a-8070-820e7ff46462\") " pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.300552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk6h7\" (UniqueName: \"kubernetes.io/projected/33d8dbaa-f07e-413b-b890-2e2d1558c504-kube-api-access-dk6h7\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.300552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-kubelet\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-systemd\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b70159bb-bbec-4946-b9aa-9e5a61d3a847-kubelet-config\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300582    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-slash\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-cni-netd\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-ovnkube-config\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-node-log\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssqxn\" (UniqueName: \"kubernetes.io/projected/33642adc-8123-442f-a633-07cc3f6d2318-kube-api-access-ssqxn\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b70159bb-bbec-4946-b9aa-9e5a61d3a847-dbus\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-run-netns\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.300888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/669814f0-ac4f-4c5a-8070-820e7ff46462-konnectivity-ca\") pod \"konnectivity-agent-sksv5\" (UID: \"669814f0-ac4f-4c5a-8070-820e7ff46462\") " pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.301427 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd469\" (UniqueName: \"kubernetes.io/projected/df585ff6-5e22-412d-b178-6dae865581a6-kube-api-access-xd469\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.301427 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.300939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-ovn\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.301847 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.301824    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 12:30:11.301931 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.301888    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 12:30:11.302080 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.302046    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 12:30:11.302153 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.302102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h5g56\""
Sep 10 12:30:11.302153 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.302135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.305208 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.304866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.305208 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.304888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ll9dp\""
Sep 10 12:30:11.305208 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.304896    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 12:30:11.305208 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.304924    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:30:11.308539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.307057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.308539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.307820    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 12:30:11.308539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.307834    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 12:30:11.308539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.307825    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7t76v\""
Sep 10 12:30:11.308539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.308035    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 12:30:11.309463 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.309441    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 12:30:11.309929 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.309897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.311192 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.311174    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 12:30:11.311563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.311544    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wp9zq\""
Sep 10 12:30:11.311771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.311754    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 12:30:11.311944 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.311930    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 12:30:11.312242 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.312198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:11.312242 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.312225    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 12:30:11.312415 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.312272    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:11.312415 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.312391    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 12:30:11.312781 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.312764    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gsnkx\""
Sep 10 12:30:11.339833 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.339119    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:25:10 +0000 UTC" deadline="2028-05-29 17:18:45.62146317 +0000 UTC"
Sep 10 12:30:11.339833 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.339149    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15052h48m34.282318273s"
Sep 10 12:30:11.390415 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.390385    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 12:30:11.394011 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.393962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal" event={"ID":"1ec8bd4921b9fbbb4ef0d7416c6238f1","Type":"ContainerStarted","Data":"2a50613e364d9019ff511e737b8e64425f7baf493441a1a861157b71d4e56493"}
Sep 10 12:30:11.397454 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.397427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal" event={"ID":"09bebac2525c04851abfa6332afa10ea","Type":"ContainerStarted","Data":"001bf92ed97d32d576cd3c35d0998c74b2514ed37437b042f5ecac781e76ffe1"}
Sep 10 12:30:11.401139 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264g4\" (UniqueName: \"kubernetes.io/projected/941ed3a3-c86b-402a-b0e5-b177716ae92b-kube-api-access-264g4\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.401263 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-socket-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.401263 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-kubelet\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.401263 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/669814f0-ac4f-4c5a-8070-820e7ff46462-konnectivity-ca\") pod \"konnectivity-agent-sksv5\" (UID: \"669814f0-ac4f-4c5a-8070-820e7ff46462\") " pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-cni-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-conf-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d8dbaa-f07e-413b-b890-2e2d1558c504-tmp-dir\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df585ff6-5e22-412d-b178-6dae865581a6-host-slash\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-systemd-units\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-env-overrides\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.401443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33642adc-8123-442f-a633-07cc3f6d2318-ovn-node-metrics-cert\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-lib-modules\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33d8dbaa-f07e-413b-b890-2e2d1558c504-hosts-file\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea64abff-11bc-4017-a4bc-a743c0bfaa58-host\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-systemd\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6rbf\" (UniqueName: \"kubernetes.io/projected/fde43510-24fe-486d-8b70-cc14bbbaea4d-kube-api-access-f6rbf\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrr6\" (UniqueName: \"kubernetes.io/projected/ea64abff-11bc-4017-a4bc-a743c0bfaa58-kube-api-access-wvrr6\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/669814f0-ac4f-4c5a-8070-820e7ff46462-agent-certs\") pod \"konnectivity-agent-sksv5\" (UID: \"669814f0-ac4f-4c5a-8070-820e7ff46462\") " pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk6h7\" (UniqueName: \"kubernetes.io/projected/33d8dbaa-f07e-413b-b890-2e2d1558c504-kube-api-access-dk6h7\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-kubelet\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-systemd\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-run\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-system-cni-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysctl-d\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysctl-conf\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/669814f0-ac4f-4c5a-8070-820e7ff46462-konnectivity-ca\") pod \"konnectivity-agent-sksv5\" (UID: \"669814f0-ac4f-4c5a-8070-820e7ff46462\") " pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fde43510-24fe-486d-8b70-cc14bbbaea4d-tmp\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.401895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdpjw\" (UniqueName: \"kubernetes.io/projected/87d02d94-2655-4758-b736-dbef01ff12df-kube-api-access-sdpjw\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-multus-certs\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-node-log\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssqxn\" (UniqueName: \"kubernetes.io/projected/33642adc-8123-442f-a633-07cc3f6d2318-kube-api-access-ssqxn\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.401983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-var-lib-kubelet\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-etc-selinux\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-cni-multus\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d8dbaa-f07e-413b-b890-2e2d1558c504-tmp-dir\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b70159bb-bbec-4946-b9aa-9e5a61d3a847-dbus\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-run-netns\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-etc-kubernetes\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd469\" (UniqueName: \"kubernetes.io/projected/df585ff6-5e22-412d-b178-6dae865581a6-kube-api-access-xd469\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-ovn\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b70159bb-bbec-4946-b9aa-9e5a61d3a847-dbus\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.402780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-sys\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-device-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/941ed3a3-c86b-402a-b0e5-b177716ae92b-cni-binary-copy\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-ovnkube-script-lib\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-registration-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-system-cni-dir\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-cni-bin\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-var-lib-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-log-socket\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-etc-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-node-log\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5g7s\" (UniqueName: \"kubernetes.io/projected/1c671f46-e4ff-488f-bbbb-bf831571ff80-kube-api-access-h5g7s\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-ovn\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-kubernetes\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df585ff6-5e22-412d-b178-6dae865581a6-host-slash\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.403608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-tuned\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-cnibin\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-hostroot\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df585ff6-5e22-412d-b178-6dae865581a6-iptables-alerter-script\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-modprobe-d\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.402982    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv9rl\" (UniqueName: \"kubernetes.io/projected/725cd292-983e-441b-b61b-e6aba3bfb11a-kube-api-access-xv9rl\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-cnibin\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-cni-bin\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea64abff-11bc-4017-a4bc-a743c0bfaa58-serviceca\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b70159bb-bbec-4946-b9aa-9e5a61d3a847-kubelet-config\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b70159bb-bbec-4946-b9aa-9e5a61d3a847-kubelet-config\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-systemd-units\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-kubelet\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.404146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-env-overrides\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-ovnkube-script-lib\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-run-netns\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.403973    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-cni-bin\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.404038    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-log-socket\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-etc-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.404171    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret podName:b70159bb-bbec-4946-b9aa-9e5a61d3a847 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:11.904155524 +0000 UTC m=+3.024510099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret") pod "global-pull-secret-syncer-rnjkw" (UID: "b70159bb-bbec-4946-b9aa-9e5a61d3a847") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-systemd\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33d8dbaa-f07e-413b-b890-2e2d1558c504-hosts-file\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-var-lib-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-slash\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df585ff6-5e22-412d-b178-6dae865581a6-iptables-alerter-script\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-slash\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-run-openvswitch\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-cni-netd\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-ovnkube-config\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33642adc-8123-442f-a633-07cc3f6d2318-host-cni-netd\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-host\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-netns\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysconfig\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-sys-fs\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-socket-dir-parent\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-k8s-cni-cncf-io\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.404979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-daemon-config\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.405907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.405098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33642adc-8123-442f-a633-07cc3f6d2318-ovnkube-config\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.407079 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.407048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33642adc-8123-442f-a633-07cc3f6d2318-ovn-node-metrics-cert\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.407252 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.407225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/669814f0-ac4f-4c5a-8070-820e7ff46462-agent-certs\") pod \"konnectivity-agent-sksv5\" (UID: \"669814f0-ac4f-4c5a-8070-820e7ff46462\") " pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.411767 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.411745    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:30:11.411861 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.411776    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:30:11.411861 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.411790    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jn46n for pod openshift-network-diagnostics/network-check-target-ggg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:11.411861 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.411854    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n podName:ef90dd25-25a9-4ad0-9967-bf1bd60532fb nodeName:}" failed. No retries permitted until 2026-09-10 12:30:11.911835933 +0000 UTC m=+3.032190511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jn46n" (UniqueName: "kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n") pod "network-check-target-ggg7m" (UID: "ef90dd25-25a9-4ad0-9967-bf1bd60532fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:11.415937 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.415912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk6h7\" (UniqueName: \"kubernetes.io/projected/33d8dbaa-f07e-413b-b890-2e2d1558c504-kube-api-access-dk6h7\") pod \"node-resolver-54nhs\" (UID: \"33d8dbaa-f07e-413b-b890-2e2d1558c504\") " pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.416036 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.416004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd469\" (UniqueName: \"kubernetes.io/projected/df585ff6-5e22-412d-b178-6dae865581a6-kube-api-access-xd469\") pod \"iptables-alerter-f25p6\" (UID: \"df585ff6-5e22-412d-b178-6dae865581a6\") " pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.416608 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.416584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssqxn\" (UniqueName: \"kubernetes.io/projected/33642adc-8123-442f-a633-07cc3f6d2318-kube-api-access-ssqxn\") pod \"ovnkube-node-6mhg7\" (UID: \"33642adc-8123-442f-a633-07cc3f6d2318\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.506040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysctl-conf\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.506207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fde43510-24fe-486d-8b70-cc14bbbaea4d-tmp\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.506207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdpjw\" (UniqueName: \"kubernetes.io/projected/87d02d94-2655-4758-b736-dbef01ff12df-kube-api-access-sdpjw\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.506207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-multus-certs\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.506207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-var-lib-kubelet\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.506207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysctl-conf\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.506207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-etc-selinux\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-cni-multus\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-multus-certs\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-etc-kubernetes\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-sys\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-device-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/941ed3a3-c86b-402a-b0e5-b177716ae92b-cni-binary-copy\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-registration-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.506461 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-system-cni-dir\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5g7s\" (UniqueName: \"kubernetes.io/projected/1c671f46-e4ff-488f-bbbb-bf831571ff80-kube-api-access-h5g7s\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-etc-kubernetes\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-kubernetes\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-kubernetes\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-tuned\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-registration-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-system-cni-dir\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-cnibin\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-hostroot\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-modprobe-d\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv9rl\" (UniqueName: \"kubernetes.io/projected/725cd292-983e-441b-b61b-e6aba3bfb11a-kube-api-access-xv9rl\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-cnibin\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-sys\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-cni-bin\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.507134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-cnibin\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea64abff-11bc-4017-a4bc-a743c0bfaa58-serviceca\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-var-lib-kubelet\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.506980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-host\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-netns\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-etc-selinux\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysconfig\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-cni-multus\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-sys-fs\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-socket-dir-parent\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-k8s-cni-cncf-io\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/941ed3a3-c86b-402a-b0e5-b177716ae92b-cni-binary-copy\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-socket-dir-parent\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-device-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-hostroot\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-k8s-cni-cncf-io\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.508025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-cni-bin\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-daemon-config\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264g4\" (UniqueName: \"kubernetes.io/projected/941ed3a3-c86b-402a-b0e5-b177716ae92b-kube-api-access-264g4\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-modprobe-d\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-socket-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-kubelet\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-socket-dir\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea64abff-11bc-4017-a4bc-a743c0bfaa58-serviceca\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-host\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-run-netns\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysconfig\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-daemon-config\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/725cd292-983e-441b-b61b-e6aba3bfb11a-sys-fs\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-cni-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-conf-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.507999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-lib-modules\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea64abff-11bc-4017-a4bc-a743c0bfaa58-host\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-systemd\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6rbf\" (UniqueName: \"kubernetes.io/projected/fde43510-24fe-486d-8b70-cc14bbbaea4d-kube-api-access-f6rbf\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrr6\" (UniqueName: \"kubernetes.io/projected/ea64abff-11bc-4017-a4bc-a743c0bfaa58-kube-api-access-wvrr6\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-run\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-system-cni-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysctl-d\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-host-var-lib-kubelet\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-lib-modules\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-conf-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87d02d94-2655-4758-b736-dbef01ff12df-cnibin\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-multus-cni-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-run\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea64abff-11bc-4017-a4bc-a743c0bfaa58-host\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.508517    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-systemd\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/941ed3a3-c86b-402a-b0e5-b177716ae92b-system-cni-dir\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.509722 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-sysctl-d\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.510470 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.509106    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:12.009058524 +0000 UTC m=+3.129413092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:11.510470 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.508662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87d02d94-2655-4758-b736-dbef01ff12df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.510470 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.510357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fde43510-24fe-486d-8b70-cc14bbbaea4d-tmp\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.512597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.511240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fde43510-24fe-486d-8b70-cc14bbbaea4d-etc-tuned\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.518907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.518878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5g7s\" (UniqueName: \"kubernetes.io/projected/1c671f46-e4ff-488f-bbbb-bf831571ff80-kube-api-access-h5g7s\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:11.519045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.519024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-264g4\" (UniqueName: \"kubernetes.io/projected/941ed3a3-c86b-402a-b0e5-b177716ae92b-kube-api-access-264g4\") pod \"multus-mb7ks\" (UID: \"941ed3a3-c86b-402a-b0e5-b177716ae92b\") " pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.519598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.519540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdpjw\" (UniqueName: \"kubernetes.io/projected/87d02d94-2655-4758-b736-dbef01ff12df-kube-api-access-sdpjw\") pod \"multus-additional-cni-plugins-4nxmq\" (UID: \"87d02d94-2655-4758-b736-dbef01ff12df\") " pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.519598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.519559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv9rl\" (UniqueName: \"kubernetes.io/projected/725cd292-983e-441b-b61b-e6aba3bfb11a-kube-api-access-xv9rl\") pod \"aws-ebs-csi-driver-node-x97m4\" (UID: \"725cd292-983e-441b-b61b-e6aba3bfb11a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.521062 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.521036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6rbf\" (UniqueName: \"kubernetes.io/projected/fde43510-24fe-486d-8b70-cc14bbbaea4d-kube-api-access-f6rbf\") pod \"tuned-k7lp2\" (UID: \"fde43510-24fe-486d-8b70-cc14bbbaea4d\") " pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.521528 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.521496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrr6\" (UniqueName: \"kubernetes.io/projected/ea64abff-11bc-4017-a4bc-a743c0bfaa58-kube-api-access-wvrr6\") pod \"node-ca-7nwfn\" (UID: \"ea64abff-11bc-4017-a4bc-a743c0bfaa58\") " pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.604453 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.604417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:11.613741 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.613540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-54nhs"
Sep 10 12:30:11.621650 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.621622    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:30:11.623969 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.623940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f25p6"
Sep 10 12:30:11.631037 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.631010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:11.646134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.646097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4"
Sep 10 12:30:11.653231 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.653200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k7lp2"
Sep 10 12:30:11.660292 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.660258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nwfn"
Sep 10 12:30:11.668343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.668315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4nxmq"
Sep 10 12:30:11.674542 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.674509    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mb7ks"
Sep 10 12:30:11.912093 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.912005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:11.912093 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:11.912052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:11.912292 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.912176    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:11.912292 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.912200    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:30:11.912292 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.912229    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:30:11.912292 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.912232    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret podName:b70159bb-bbec-4946-b9aa-9e5a61d3a847 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:12.912218669 +0000 UTC m=+4.032573237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret") pod "global-pull-secret-syncer-rnjkw" (UID: "b70159bb-bbec-4946-b9aa-9e5a61d3a847") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:11.912292 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.912240    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jn46n for pod openshift-network-diagnostics/network-check-target-ggg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:11.912475 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:11.912310    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n podName:ef90dd25-25a9-4ad0-9967-bf1bd60532fb nodeName:}" failed. No retries permitted until 2026-09-10 12:30:12.912272741 +0000 UTC m=+4.032627298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jn46n" (UniqueName: "kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n") pod "network-check-target-ggg7m" (UID: "ef90dd25-25a9-4ad0-9967-bf1bd60532fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:12.013215 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:12.013182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:12.013403 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.013345    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:12.013490 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.013424    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:13.013401909 +0000 UTC m=+4.133756465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:12.340350 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:12.340288    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:25:10 +0000 UTC" deadline="2028-05-28 05:32:31.303097016 +0000 UTC"
Sep 10 12:30:12.340350 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:12.340342    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15017h2m18.96276017s"
Sep 10 12:30:12.648676 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.648644    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d02d94_2655_4758_b736_dbef01ff12df.slice/crio-b8733a2b334b9bd5164691c839158bf1315bc98707594f63919fed8aa9538026 WatchSource:0}: Error finding container b8733a2b334b9bd5164691c839158bf1315bc98707594f63919fed8aa9538026: Status 404 returned error can't find the container with id b8733a2b334b9bd5164691c839158bf1315bc98707594f63919fed8aa9538026
Sep 10 12:30:12.650663 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.650625    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde43510_24fe_486d_8b70_cc14bbbaea4d.slice/crio-505053796ca72b20b16cb93d16439eb971ef5ceb7ab379514d51763b3add7571 WatchSource:0}: Error finding container 505053796ca72b20b16cb93d16439eb971ef5ceb7ab379514d51763b3add7571: Status 404 returned error can't find the container with id 505053796ca72b20b16cb93d16439eb971ef5ceb7ab379514d51763b3add7571
Sep 10 12:30:12.651703 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.651678    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf585ff6_5e22_412d_b178_6dae865581a6.slice/crio-4f20b989d970ef20cf2e7b374f6bd6c9816291f8eed11b50706d99cfc52924f4 WatchSource:0}: Error finding container 4f20b989d970ef20cf2e7b374f6bd6c9816291f8eed11b50706d99cfc52924f4: Status 404 returned error can't find the container with id 4f20b989d970ef20cf2e7b374f6bd6c9816291f8eed11b50706d99cfc52924f4
Sep 10 12:30:12.655690 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.655664    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941ed3a3_c86b_402a_b0e5_b177716ae92b.slice/crio-a1aed2fa92a372e1ad3d40cde096290a3cd52b71fe23820a755983cf38e95f56 WatchSource:0}: Error finding container a1aed2fa92a372e1ad3d40cde096290a3cd52b71fe23820a755983cf38e95f56: Status 404 returned error can't find the container with id a1aed2fa92a372e1ad3d40cde096290a3cd52b71fe23820a755983cf38e95f56
Sep 10 12:30:12.657736 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.657605    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669814f0_ac4f_4c5a_8070_820e7ff46462.slice/crio-c39fc7ccf6cb539f92cce4b8beb0511bd2af183f228fffe5f64592ef65fb976c WatchSource:0}: Error finding container c39fc7ccf6cb539f92cce4b8beb0511bd2af183f228fffe5f64592ef65fb976c: Status 404 returned error can't find the container with id c39fc7ccf6cb539f92cce4b8beb0511bd2af183f228fffe5f64592ef65fb976c
Sep 10 12:30:12.659166 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.659034    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725cd292_983e_441b_b61b_e6aba3bfb11a.slice/crio-2d8779abee8ea99d9ec58216a3797d708f8198d9786e5a47bc3bc8c38c982573 WatchSource:0}: Error finding container 2d8779abee8ea99d9ec58216a3797d708f8198d9786e5a47bc3bc8c38c982573: Status 404 returned error can't find the container with id 2d8779abee8ea99d9ec58216a3797d708f8198d9786e5a47bc3bc8c38c982573
Sep 10 12:30:12.660092 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.659959    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea64abff_11bc_4017_a4bc_a743c0bfaa58.slice/crio-ce14ad680bbeb7e2e9ffa53e1295725ccd983b42db6853ea4d0720665930bb22 WatchSource:0}: Error finding container ce14ad680bbeb7e2e9ffa53e1295725ccd983b42db6853ea4d0720665930bb22: Status 404 returned error can't find the container with id ce14ad680bbeb7e2e9ffa53e1295725ccd983b42db6853ea4d0720665930bb22
Sep 10 12:30:12.660917 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.660878    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d8dbaa_f07e_413b_b890_2e2d1558c504.slice/crio-600ee39f3005da7fc18d9c8bba83eeb53664e56424aea67562e4787d3c1c820e WatchSource:0}: Error finding container 600ee39f3005da7fc18d9c8bba83eeb53664e56424aea67562e4787d3c1c820e: Status 404 returned error can't find the container with id 600ee39f3005da7fc18d9c8bba83eeb53664e56424aea67562e4787d3c1c820e
Sep 10 12:30:12.661653 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:12.661633    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33642adc_8123_442f_a633_07cc3f6d2318.slice/crio-53dda62789582551e3c97983324b423cc610a11ea9eabe7aaf4ee84937de3a86 WatchSource:0}: Error finding container 53dda62789582551e3c97983324b423cc610a11ea9eabe7aaf4ee84937de3a86: Status 404 returned error can't find the container with id 53dda62789582551e3c97983324b423cc610a11ea9eabe7aaf4ee84937de3a86
Sep 10 12:30:12.921045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:12.921015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:12.921195 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:12.921076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:12.921261 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.921191    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:12.921261 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.921207    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:30:12.921261 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.921232    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:30:12.921261 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.921246    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jn46n for pod openshift-network-diagnostics/network-check-target-ggg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:12.921455 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.921311    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret podName:b70159bb-bbec-4946-b9aa-9e5a61d3a847 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:14.92128992 +0000 UTC m=+6.041644477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret") pod "global-pull-secret-syncer-rnjkw" (UID: "b70159bb-bbec-4946-b9aa-9e5a61d3a847") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:12.921455 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:12.921331    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n podName:ef90dd25-25a9-4ad0-9967-bf1bd60532fb nodeName:}" failed. No retries permitted until 2026-09-10 12:30:14.921322193 +0000 UTC m=+6.041676749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jn46n" (UniqueName: "kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n") pod "network-check-target-ggg7m" (UID: "ef90dd25-25a9-4ad0-9967-bf1bd60532fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:13.022281 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.022247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:13.022456 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:13.022423    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:13.022524 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:13.022511    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:15.022486751 +0000 UTC m=+6.142841324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:13.392430 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.392392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:13.392896 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:13.392546    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:13.393015 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.392994    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:13.393127 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:13.393106    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:13.393212 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.393198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:13.393312 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:13.393277    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:13.414370 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.414259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal" event={"ID":"1ec8bd4921b9fbbb4ef0d7416c6238f1","Type":"ContainerStarted","Data":"b9b3120d48fef2ce541497b2e5c208357c0664237f807473fac2d72e66fa29f7"}
Sep 10 12:30:13.417897 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.417864    2565 generic.go:356] "Generic (PLEG): container finished" podID="09bebac2525c04851abfa6332afa10ea" containerID="63597e720eeeecdfb108a491aa838c39b063b92928aa49b5b901f985cb3afe9c" exitCode=0
Sep 10 12:30:13.418052 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.417953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal" event={"ID":"09bebac2525c04851abfa6332afa10ea","Type":"ContainerDied","Data":"63597e720eeeecdfb108a491aa838c39b063b92928aa49b5b901f985cb3afe9c"}
Sep 10 12:30:13.429207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.428857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"53dda62789582551e3c97983324b423cc610a11ea9eabe7aaf4ee84937de3a86"}
Sep 10 12:30:13.434492 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.433780    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-88.ec2.internal" podStartSLOduration=3.433761489 podStartE2EDuration="3.433761489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:13.433705623 +0000 UTC m=+4.554060202" watchObservedRunningTime="2026-09-10 12:30:13.433761489 +0000 UTC m=+4.554116071"
Sep 10 12:30:13.434492 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.434003    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4" event={"ID":"725cd292-983e-441b-b61b-e6aba3bfb11a","Type":"ContainerStarted","Data":"2d8779abee8ea99d9ec58216a3797d708f8198d9786e5a47bc3bc8c38c982573"}
Sep 10 12:30:13.442472 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.442354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k7lp2" event={"ID":"fde43510-24fe-486d-8b70-cc14bbbaea4d","Type":"ContainerStarted","Data":"505053796ca72b20b16cb93d16439eb971ef5ceb7ab379514d51763b3add7571"}
Sep 10 12:30:13.449222 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.449142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerStarted","Data":"b8733a2b334b9bd5164691c839158bf1315bc98707594f63919fed8aa9538026"}
Sep 10 12:30:13.455683 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.455578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-54nhs" event={"ID":"33d8dbaa-f07e-413b-b890-2e2d1558c504","Type":"ContainerStarted","Data":"600ee39f3005da7fc18d9c8bba83eeb53664e56424aea67562e4787d3c1c820e"}
Sep 10 12:30:13.460611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.460575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nwfn" event={"ID":"ea64abff-11bc-4017-a4bc-a743c0bfaa58","Type":"ContainerStarted","Data":"ce14ad680bbeb7e2e9ffa53e1295725ccd983b42db6853ea4d0720665930bb22"}
Sep 10 12:30:13.463423 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.463350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sksv5" event={"ID":"669814f0-ac4f-4c5a-8070-820e7ff46462","Type":"ContainerStarted","Data":"c39fc7ccf6cb539f92cce4b8beb0511bd2af183f228fffe5f64592ef65fb976c"}
Sep 10 12:30:13.465265 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.465214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mb7ks" event={"ID":"941ed3a3-c86b-402a-b0e5-b177716ae92b","Type":"ContainerStarted","Data":"a1aed2fa92a372e1ad3d40cde096290a3cd52b71fe23820a755983cf38e95f56"}
Sep 10 12:30:13.474073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:13.473991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f25p6" event={"ID":"df585ff6-5e22-412d-b178-6dae865581a6","Type":"ContainerStarted","Data":"4f20b989d970ef20cf2e7b374f6bd6c9816291f8eed11b50706d99cfc52924f4"}
Sep 10 12:30:14.497422 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:14.497375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal" event={"ID":"09bebac2525c04851abfa6332afa10ea","Type":"ContainerStarted","Data":"6b43887ebe7f5169b0a8f26766e0573b50d7fd5ef16b84968e5d0d7fc1a95dcc"}
Sep 10 12:30:14.515093 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:14.515027    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-88.ec2.internal" podStartSLOduration=4.51500173 podStartE2EDuration="4.51500173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:14.514609338 +0000 UTC m=+5.634963921" watchObservedRunningTime="2026-09-10 12:30:14.51500173 +0000 UTC m=+5.635356314"
Sep 10 12:30:14.940950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:14.940912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:14.941142 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:14.940981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:14.941220 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:14.941162    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:14.941290 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:14.941230    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret podName:b70159bb-bbec-4946-b9aa-9e5a61d3a847 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:18.941210297 +0000 UTC m=+10.061564857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret") pod "global-pull-secret-syncer-rnjkw" (UID: "b70159bb-bbec-4946-b9aa-9e5a61d3a847") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:14.941975 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:14.941950    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:30:14.941975 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:14.941976    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:30:14.942150 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:14.942001    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jn46n for pod openshift-network-diagnostics/network-check-target-ggg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:14.942150 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:14.942051    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n podName:ef90dd25-25a9-4ad0-9967-bf1bd60532fb nodeName:}" failed. No retries permitted until 2026-09-10 12:30:18.942034747 +0000 UTC m=+10.062389309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jn46n" (UniqueName: "kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n") pod "network-check-target-ggg7m" (UID: "ef90dd25-25a9-4ad0-9967-bf1bd60532fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:15.041869 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:15.041825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:15.042054 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:15.042039    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:15.042138 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:15.042107    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:19.042087794 +0000 UTC m=+10.162442356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:15.391519 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:15.391431    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:15.391682 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:15.391594    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:15.391886 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:15.391864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:15.391998 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:15.391974    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:15.392059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:15.391989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:15.392104 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:15.392076    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:17.392393 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:17.392354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:17.392830 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:17.392494    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:17.392952 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:17.392902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:17.393026 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:17.392995    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:17.393081 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:17.393061    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:17.393323 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:17.393145    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:18.976288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:18.976252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:18.976761 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:18.976305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:18.976761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:18.976505    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:18.976761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:18.976569    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret podName:b70159bb-bbec-4946-b9aa-9e5a61d3a847 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:26.976548414 +0000 UTC m=+18.096902991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret") pod "global-pull-secret-syncer-rnjkw" (UID: "b70159bb-bbec-4946-b9aa-9e5a61d3a847") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:18.976761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:18.976658    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:30:18.976761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:18.976674    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:30:18.976761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:18.976687    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jn46n for pod openshift-network-diagnostics/network-check-target-ggg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:18.976761 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:18.976722    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n podName:ef90dd25-25a9-4ad0-9967-bf1bd60532fb nodeName:}" failed. No retries permitted until 2026-09-10 12:30:26.976711299 +0000 UTC m=+18.097065854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jn46n" (UniqueName: "kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n") pod "network-check-target-ggg7m" (UID: "ef90dd25-25a9-4ad0-9967-bf1bd60532fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:19.077347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:19.077316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:19.077541 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:19.077453    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:19.077541 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:19.077514    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:27.077493449 +0000 UTC m=+18.197848020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:19.392538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:19.391817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:19.392538 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:19.391935    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:19.392538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:19.392225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:19.392538 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:19.392334    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:19.392538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:19.392382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:19.392538 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:19.392449    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:21.390362 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:21.390328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:21.390809 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:21.390439    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:21.390809 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:21.390800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:21.390920 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:21.390882    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:21.391140 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:21.391022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:21.391140 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:21.391108    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:23.389253 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:23.389193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:23.389253 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:23.389229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:23.389826 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:23.389193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:23.389826 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:23.389335    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:23.389826 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:23.389490    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:23.389826 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:23.389588    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:25.388985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:25.388956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:25.388985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:25.388974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:25.389531 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:25.389099    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:25.389531 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:25.389152    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:25.389531 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:25.389200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:25.389531 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:25.389271    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:27.040799 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:27.040767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:27.041281 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:27.040816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:27.041281 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.040917    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:27.041281 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.040943    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:30:27.041281 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.040972    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:30:27.041281 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.040987    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jn46n for pod openshift-network-diagnostics/network-check-target-ggg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:27.041281 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.040976    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret podName:b70159bb-bbec-4946-b9aa-9e5a61d3a847 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:43.040961821 +0000 UTC m=+34.161316376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret") pod "global-pull-secret-syncer-rnjkw" (UID: "b70159bb-bbec-4946-b9aa-9e5a61d3a847") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:27.041281 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.041045    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n podName:ef90dd25-25a9-4ad0-9967-bf1bd60532fb nodeName:}" failed. No retries permitted until 2026-09-10 12:30:43.041032688 +0000 UTC m=+34.161387243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jn46n" (UniqueName: "kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n") pod "network-check-target-ggg7m" (UID: "ef90dd25-25a9-4ad0-9967-bf1bd60532fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:27.141439 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:27.141400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:27.141620 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.141564    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:27.141690 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.141644    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:43.141621366 +0000 UTC m=+34.261975938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:27.388894 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:27.388822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:27.388894 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:27.388822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:27.389067 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:27.388938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:27.389067 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.388957    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:27.389067 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.389011    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:27.389239 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:27.389091    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:29.389668 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:29.389632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:29.390138 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:29.389718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:29.390138 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:29.389739    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:29.390138 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:29.389813    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:29.390138 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:29.389884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:29.390138 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:29.389960    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:31.389036 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.389008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:31.389415 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:31.389126    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:31.389519 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.389499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:31.389631 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:31.389611    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:31.389706 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.389667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:31.389757 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:31.389738    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:31.543886 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.543397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mb7ks" event={"ID":"941ed3a3-c86b-402a-b0e5-b177716ae92b","Type":"ContainerStarted","Data":"9ccfeee4dfb679a009f9c7548fad862f994a99355c22636693b0a2460eabc61c"}
Sep 10 12:30:31.546610 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.546567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"19225e51e267131d13baf1176619a7d909dbc60b39e133fc530ae8ce2d779c5f"}
Sep 10 12:30:31.548385 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.548353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4" event={"ID":"725cd292-983e-441b-b61b-e6aba3bfb11a","Type":"ContainerStarted","Data":"90cc33fc0118cb13ee4c3652f9f826790e57828d309a5b8ddfbe01631bcdea8d"}
Sep 10 12:30:31.553244 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.553062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k7lp2" event={"ID":"fde43510-24fe-486d-8b70-cc14bbbaea4d","Type":"ContainerStarted","Data":"20a96406e0a0f48aae30afcc865a14f4997514c9fb6d9ebfb181f90f543f72c8"}
Sep 10 12:30:31.557460 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.557376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerStarted","Data":"36a5a2a24ff5708697fe9a0ceac5136408ed5cf4d9e47d8a6e627443d9710557"}
Sep 10 12:30:31.559534 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.559504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-54nhs" event={"ID":"33d8dbaa-f07e-413b-b890-2e2d1558c504","Type":"ContainerStarted","Data":"2b5b696d9d8e085048102f5d5eaddaacd662c181e6ab11c21bb742602b58761f"}
Sep 10 12:30:31.562778 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.562750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nwfn" event={"ID":"ea64abff-11bc-4017-a4bc-a743c0bfaa58","Type":"ContainerStarted","Data":"59e8ccf1783ad5d4c7669f8b79889f3ce7a62bb22e20871ce08f99ebbd8d4e8c"}
Sep 10 12:30:31.564495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.564442    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mb7ks" podStartSLOduration=2.8514636380000002 podStartE2EDuration="21.564425115s" totalImagesPullingTime="18.712961477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:31.56402521 +0000 UTC m=+22.684379789" watchObservedRunningTime="2026-09-10 12:30:31.564425115 +0000 UTC m=+22.684779730"
Sep 10 12:30:31.565442 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.565415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sksv5" event={"ID":"669814f0-ac4f-4c5a-8070-820e7ff46462","Type":"ContainerStarted","Data":"40c56ceabc22cc756dbebc79efe2c65beecf5d167d97b327122847e40ca6048e"}
Sep 10 12:30:31.585596 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.585074    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k7lp2" podStartSLOduration=2.9228124749999997 podStartE2EDuration="21.585053508s" totalImagesPullingTime="18.662241033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:31.583567731 +0000 UTC m=+22.703922308" watchObservedRunningTime="2026-09-10 12:30:31.585053508 +0000 UTC m=+22.705408086"
Sep 10 12:30:31.598668 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.598626    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-54nhs" podStartSLOduration=2.949915204 podStartE2EDuration="21.598611446s" totalImagesPullingTime="18.648696242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:31.598412276 +0000 UTC m=+22.718766855" watchObservedRunningTime="2026-09-10 12:30:31.598611446 +0000 UTC m=+22.718966022"
Sep 10 12:30:31.619331 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.619118    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7nwfn" podStartSLOduration=2.967589539 podStartE2EDuration="21.619101406s" totalImagesPullingTime="18.651511867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:31.618886142 +0000 UTC m=+22.739240720" watchObservedRunningTime="2026-09-10 12:30:31.619101406 +0000 UTC m=+22.739455965"
Sep 10 12:30:31.673313 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.673254    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sksv5" podStartSLOduration=6.942999334 podStartE2EDuration="21.673206219s" totalImagesPullingTime="14.730206885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:31.672799524 +0000 UTC m=+22.793154100" watchObservedRunningTime="2026-09-10 12:30:31.673206219 +0000 UTC m=+22.793560796"
Sep 10 12:30:31.855089 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.855059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:31.855816 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:31.855795    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:32.569057 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.569021    2565 generic.go:356] "Generic (PLEG): container finished" podID="87d02d94-2655-4758-b736-dbef01ff12df" containerID="36a5a2a24ff5708697fe9a0ceac5136408ed5cf4d9e47d8a6e627443d9710557" exitCode=0
Sep 10 12:30:32.569958 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.569101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerDied","Data":"36a5a2a24ff5708697fe9a0ceac5136408ed5cf4d9e47d8a6e627443d9710557"}
Sep 10 12:30:32.570828 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.570786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f25p6" event={"ID":"df585ff6-5e22-412d-b178-6dae865581a6","Type":"ContainerStarted","Data":"cb33b553294be9592a7383fd000eafc4c39a0eb9da2f9ba1924c6ad4b8c59b29"}
Sep 10 12:30:32.577306 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.577284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"da54d30bcc4bffbb95c0f4f11e4a339d21995353722650cdd61c4486371f142b"}
Sep 10 12:30:32.577448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.577356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"074dcd0f7297414be3284baf13bc268a583bbf8d445e20233b320d55c06e151f"}
Sep 10 12:30:32.577448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.577406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"e48a1e32d31bf3094e9ad0e4192afa6d7a1fdd16787b1496658d0d58f9adad11"}
Sep 10 12:30:32.577558 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.577450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"fec3723270167b591486314ddeb900c4f568b6032538a436478d78f799ff8bc8"}
Sep 10 12:30:32.577558 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:32.577499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"a58b6aa5af8f320f7def08c16ba4aaf5c709f52bc1250acc23c989655a0dd7d3"}
Sep 10 12:30:33.211393 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.211369    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 12:30:33.364482 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.364307    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:30:33.211387769Z","UUID":"be0029a4-c01c-4309-a0ec-abc64dc70f1a","Handler":null,"Name":"","Endpoint":""}
Sep 10 12:30:33.366310 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.366280    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 12:30:33.366310 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.366313    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 12:30:33.392623 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.392571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:33.392623 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.392610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:33.392832 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:33.392679    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:33.392832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.392736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:33.392832 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:33.392818    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:33.392975 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:33.392898    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:33.580598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.580559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4" event={"ID":"725cd292-983e-441b-b61b-e6aba3bfb11a","Type":"ContainerStarted","Data":"fd7a5b9edc9291c0480e7025ff21bc593dd2794593dca9d4c3da40de78955969"}
Sep 10 12:30:33.580598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:33.580597    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 12:30:34.585572 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:34.585529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"b609aa41ae63adfd3bcf59ae1e8b26b92a75169fd84b98f43c0929bfee0db94b"}
Sep 10 12:30:35.389869 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:35.389830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:35.390048 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:35.389835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:35.390048 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:35.389957    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:35.390048 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:35.389974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:35.390242 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:35.390098    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:35.390242 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:35.390188    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:35.590838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:35.590807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4" event={"ID":"725cd292-983e-441b-b61b-e6aba3bfb11a","Type":"ContainerStarted","Data":"29308b52708fccc5a3e9f4c161219c662cb88085bb4f7d423a964cade216d364"}
Sep 10 12:30:35.613464 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:35.613402    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f25p6" podStartSLOduration=6.952985808 podStartE2EDuration="25.613382422s" totalImagesPullingTime="18.660396614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:32.610619504 +0000 UTC m=+23.730974082" watchObservedRunningTime="2026-09-10 12:30:35.613382422 +0000 UTC m=+26.733737033"
Sep 10 12:30:35.613708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:35.613683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x97m4" podStartSLOduration=3.881743861 podStartE2EDuration="25.613673278s" totalImagesPullingTime="21.731929417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:35.613113146 +0000 UTC m=+26.733467724" watchObservedRunningTime="2026-09-10 12:30:35.613673278 +0000 UTC m=+26.734027854"
Sep 10 12:30:36.220927 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:36.220727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:36.221104 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:36.221022    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 12:30:36.221546 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:36.221506    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sksv5"
Sep 10 12:30:37.389423 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.389400    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:37.389423 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.389420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:37.390016 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.389399    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:37.390016 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:37.389649    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:37.390016 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:37.389581    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:37.390016 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:37.389769    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:37.600394 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.600356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" event={"ID":"33642adc-8123-442f-a633-07cc3f6d2318","Type":"ContainerStarted","Data":"6e3dfd292db79db2a658e1b64ce3d5d4984c7f87128f3351916639585961c148"}
Sep 10 12:30:37.600632 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.600612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:37.600732 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.600680    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:37.602478 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.602441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerStarted","Data":"309347e2c26d0b88f90c69b38d8fe890ebd34ce2aff86acf66d2afb66159c38e"}
Sep 10 12:30:37.618668 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.616745    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:37.634084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:37.634037    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7" podStartSLOduration=8.924731254 podStartE2EDuration="27.63402402s" totalImagesPullingTime="18.709292766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:37.633842731 +0000 UTC m=+28.754197307" watchObservedRunningTime="2026-09-10 12:30:37.63402402 +0000 UTC m=+28.754378597"
Sep 10 12:30:38.607279 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:38.607077    2565 generic.go:356] "Generic (PLEG): container finished" podID="87d02d94-2655-4758-b736-dbef01ff12df" containerID="309347e2c26d0b88f90c69b38d8fe890ebd34ce2aff86acf66d2afb66159c38e" exitCode=0
Sep 10 12:30:38.607753 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:38.607169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerDied","Data":"309347e2c26d0b88f90c69b38d8fe890ebd34ce2aff86acf66d2afb66159c38e"}
Sep 10 12:30:38.607753 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:38.607730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:38.624015 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:38.623992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:30:39.273745 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:39.273712    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnjkw"]
Sep 10 12:30:39.273940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:39.273865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:39.274000 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:39.273982    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:39.276561 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:39.276535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggg7m"]
Sep 10 12:30:39.276709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:39.276688    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:39.276862 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:39.276804    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:39.287570 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:39.287546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8lpqz"]
Sep 10 12:30:39.287715 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:39.287697    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:39.287825 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:39.287803    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:40.389231 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:40.389183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:40.389589 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:40.389298    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:40.615635 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:40.615597    2565 generic.go:356] "Generic (PLEG): container finished" podID="87d02d94-2655-4758-b736-dbef01ff12df" containerID="0d20e0d8df9b970685e0cdb9a25d6e9fe454f0c1ed635eb5ee4cb3f22baeb570" exitCode=0
Sep 10 12:30:40.616304 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:40.616273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerDied","Data":"0d20e0d8df9b970685e0cdb9a25d6e9fe454f0c1ed635eb5ee4cb3f22baeb570"}
Sep 10 12:30:41.392630 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:41.392607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:41.392916 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:41.392712    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:41.392916 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:41.392763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:41.392916 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:41.392858    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:41.623058 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:41.622978    2565 generic.go:356] "Generic (PLEG): container finished" podID="87d02d94-2655-4758-b736-dbef01ff12df" containerID="92a282daea0921d788e20bd1812cc306b84fa8e25c05051cce8ea950d5ffb4be" exitCode=0
Sep 10 12:30:41.623058 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:41.623019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerDied","Data":"92a282daea0921d788e20bd1812cc306b84fa8e25c05051cce8ea950d5ffb4be"}
Sep 10 12:30:42.388811 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:42.388781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:42.388995 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:42.388907    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:43.059981 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:43.059948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:43.059981 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:43.059998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:43.060516 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.060109    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:30:43.060516 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.060117    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:43.060516 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.060132    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:30:43.060516 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.060143    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jn46n for pod openshift-network-diagnostics/network-check-target-ggg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:43.060516 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.060187    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n podName:ef90dd25-25a9-4ad0-9967-bf1bd60532fb nodeName:}" failed. No retries permitted until 2026-09-10 12:31:15.060174173 +0000 UTC m=+66.180528728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jn46n" (UniqueName: "kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n") pod "network-check-target-ggg7m" (UID: "ef90dd25-25a9-4ad0-9967-bf1bd60532fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:30:43.060516 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.060201    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret podName:b70159bb-bbec-4946-b9aa-9e5a61d3a847 nodeName:}" failed. No retries permitted until 2026-09-10 12:31:15.060194891 +0000 UTC m=+66.180549445 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret") pod "global-pull-secret-syncer-rnjkw" (UID: "b70159bb-bbec-4946-b9aa-9e5a61d3a847") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:30:43.160465 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:43.160437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:43.160615 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.160570    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:43.160679 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.160623    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:31:15.160611043 +0000 UTC m=+66.280965599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:30:43.389336 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:43.389302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:43.389505 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.389436    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lpqz" podUID="1c671f46-e4ff-488f-bbbb-bf831571ff80"
Sep 10 12:30:43.389505 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:43.389492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:43.389631 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:43.389608    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnjkw" podUID="b70159bb-bbec-4946-b9aa-9e5a61d3a847"
Sep 10 12:30:44.389343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:44.389092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:44.389728 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:44.389434    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggg7m" podUID="ef90dd25-25a9-4ad0-9967-bf1bd60532fb"
Sep 10 12:30:45.212710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.212678    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-88.ec2.internal" event="NodeReady"
Sep 10 12:30:45.212887 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.212824    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 12:30:45.248421 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.248387    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d99755df-294d4"]
Sep 10 12:30:45.256612 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.256590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.259657 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.259633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 12:30:45.259770 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.259680    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t2rx6\""
Sep 10 12:30:45.259853 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.259835    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 12:30:45.259923 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.259862    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 12:30:45.269073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.269046    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dcsnd"]
Sep 10 12:30:45.271710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.271685    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d99755df-294d4"]
Sep 10 12:30:45.271710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.271722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r2q87"]
Sep 10 12:30:45.272275 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.272250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 12:30:45.272560 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.272536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.274333 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.274314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.276513 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.275637    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 12:30:45.276513 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.275799    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 12:30:45.276647 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.276555    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dcsnd"]
Sep 10 12:30:45.276703 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.276685    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 12:30:45.276982 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.276964    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgmkk\""
Sep 10 12:30:45.277155 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.277135    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 12:30:45.277281 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.277166    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zj5jx\""
Sep 10 12:30:45.277281 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.277251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 12:30:45.281784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.281050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2q87"]
Sep 10 12:30:45.377120 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cbfec41-74aa-4b2d-9f78-7403b3630669-config-volume\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.377120 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cbfec41-74aa-4b2d-9f78-7403b3630669-tmp-dir\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.377374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/456583ce-77c9-4ee0-b771-bb8cc82efb51-cert\") pod \"ingress-canary-r2q87\" (UID: \"456583ce-77c9-4ee0-b771-bb8cc82efb51\") " pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.377374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdtf\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-kube-api-access-fhdtf\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-certificates\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-installation-pull-secrets\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-image-registry-private-configuration\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlzp2\" (UniqueName: \"kubernetes.io/projected/3cbfec41-74aa-4b2d-9f78-7403b3630669-kube-api-access-qlzp2\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.377626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj2mk\" (UniqueName: \"kubernetes.io/projected/456583ce-77c9-4ee0-b771-bb8cc82efb51-kube-api-access-bj2mk\") pod \"ingress-canary-r2q87\" (UID: \"456583ce-77c9-4ee0-b771-bb8cc82efb51\") " pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.377626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-trusted-ca\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-ca-trust-extracted\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-bound-sa-token\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.377626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.377622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.389293 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.389264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:30:45.389293 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.389280    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:30:45.392479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.392351    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 12:30:45.392479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.392377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 12:30:45.392479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.392456    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sz48d\""
Sep 10 12:30:45.421582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.421545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sksv5_669814f0-ac4f-4c5a-8070-820e7ff46462/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:45.478529 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.478529 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlzp2\" (UniqueName: \"kubernetes.io/projected/3cbfec41-74aa-4b2d-9f78-7403b3630669-kube-api-access-qlzp2\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.478529 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj2mk\" (UniqueName: \"kubernetes.io/projected/456583ce-77c9-4ee0-b771-bb8cc82efb51-kube-api-access-bj2mk\") pod \"ingress-canary-r2q87\" (UID: \"456583ce-77c9-4ee0-b771-bb8cc82efb51\") " pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-trusted-ca\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-ca-trust-extracted\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-bound-sa-token\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.478631    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.478654    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.478718    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.478726    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:30:45.978704598 +0000 UTC m=+37.099059157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:30:45.478801 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.478783    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:45.978766383 +0000 UTC m=+37.099120961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cbfec41-74aa-4b2d-9f78-7403b3630669-config-volume\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cbfec41-74aa-4b2d-9f78-7403b3630669-tmp-dir\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/456583ce-77c9-4ee0-b771-bb8cc82efb51-cert\") pod \"ingress-canary-r2q87\" (UID: \"456583ce-77c9-4ee0-b771-bb8cc82efb51\") " pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdtf\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-kube-api-access-fhdtf\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-certificates\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.478998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-installation-pull-secrets\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.479018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-image-registry-private-configuration\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.479188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.479097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-ca-trust-extracted\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.479604 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.479588    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cbfec41-74aa-4b2d-9f78-7403b3630669-config-volume\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.479817 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.479797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-trusted-ca\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.479892 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.479825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cbfec41-74aa-4b2d-9f78-7403b3630669-tmp-dir\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.480028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.480010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-certificates\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.483632 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.483561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-image-registry-private-configuration\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.483632 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.483566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-installation-pull-secrets\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.483632 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.483566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/456583ce-77c9-4ee0-b771-bb8cc82efb51-cert\") pod \"ingress-canary-r2q87\" (UID: \"456583ce-77c9-4ee0-b771-bb8cc82efb51\") " pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.490078 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.490041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-bound-sa-token\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.490570 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.490549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlzp2\" (UniqueName: \"kubernetes.io/projected/3cbfec41-74aa-4b2d-9f78-7403b3630669-kube-api-access-qlzp2\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.491343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.491319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj2mk\" (UniqueName: \"kubernetes.io/projected/456583ce-77c9-4ee0-b771-bb8cc82efb51-kube-api-access-bj2mk\") pod \"ingress-canary-r2q87\" (UID: \"456583ce-77c9-4ee0-b771-bb8cc82efb51\") " pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.491873 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.491853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdtf\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-kube-api-access-fhdtf\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.508301 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.508269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sksv5_669814f0-ac4f-4c5a-8070-820e7ff46462/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:45.591355 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.591316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2q87"
Sep 10 12:30:45.982401 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.982362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:45.982578 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:45.982492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:45.982578 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.982550    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:30:45.982692 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.982613    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:46.982597411 +0000 UTC m=+38.102951965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:30:45.982692 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.982618    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:30:45.982692 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.982636    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:30:45.982692 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:45.982686    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:30:46.982668745 +0000 UTC m=+38.103023315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:30:46.371925 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.371842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sksv5_669814f0-ac4f-4c5a-8070-820e7ff46462/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:46.389711 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.389674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:30:46.392879 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.392852    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 12:30:46.393891 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.393870    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 12:30:46.394007 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.393866    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ll527\""
Sep 10 12:30:46.471778 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.471735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sksv5_669814f0-ac4f-4c5a-8070-820e7ff46462/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:46.992714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.992683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:46.992869 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:46.992757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:46.992869 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:46.992829    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:30:46.992869 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:46.992854    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:30:46.992869 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:46.992864    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:30:46.993002 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:46.992894    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:48.992877127 +0000 UTC m=+40.113231681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:30:46.993002 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:46.992912    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:30:48.992900522 +0000 UTC m=+40.113255077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:30:47.185894 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:47.185695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2q87"]
Sep 10 12:30:47.190136 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:30:47.189904    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456583ce_77c9_4ee0_b771_bb8cc82efb51.slice/crio-d962d142a46bf1466223a75c6942a81d7438a71041ab971fc092d467a7a79dca WatchSource:0}: Error finding container d962d142a46bf1466223a75c6942a81d7438a71041ab971fc092d467a7a79dca: Status 404 returned error can't find the container with id d962d142a46bf1466223a75c6942a81d7438a71041ab971fc092d467a7a79dca
Sep 10 12:30:47.641586 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:47.641553    2565 generic.go:356] "Generic (PLEG): container finished" podID="87d02d94-2655-4758-b736-dbef01ff12df" containerID="190be99e6c1b7fddfe9552fe927e4babe347dd74ff2c09a319cc353facd3395d" exitCode=0
Sep 10 12:30:47.642292 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:47.641632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerDied","Data":"190be99e6c1b7fddfe9552fe927e4babe347dd74ff2c09a319cc353facd3395d"}
Sep 10 12:30:47.642952 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:47.642926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2q87" event={"ID":"456583ce-77c9-4ee0-b771-bb8cc82efb51","Type":"ContainerStarted","Data":"d962d142a46bf1466223a75c6942a81d7438a71041ab971fc092d467a7a79dca"}
Sep 10 12:30:48.648600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:48.648568    2565 generic.go:356] "Generic (PLEG): container finished" podID="87d02d94-2655-4758-b736-dbef01ff12df" containerID="3897fec3f22c2ab8f2a9af20905db9c2059945bde5da8a51fe6b7e3062a62315" exitCode=0
Sep 10 12:30:48.648995 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:48.648617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerDied","Data":"3897fec3f22c2ab8f2a9af20905db9c2059945bde5da8a51fe6b7e3062a62315"}
Sep 10 12:30:49.011412 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:49.011369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:49.011597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:49.011456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:49.011597 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:49.011535    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:30:49.011597 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:49.011560    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:30:49.011597 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:49.011573    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:30:49.011763 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:49.011631    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:30:53.011609323 +0000 UTC m=+44.131963883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:30:49.011763 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:49.011648    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:30:53.011640392 +0000 UTC m=+44.131994966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:30:49.654353 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:49.654320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" event={"ID":"87d02d94-2655-4758-b736-dbef01ff12df","Type":"ContainerStarted","Data":"c84c169ec885ad3a98bedd7b552ae726acdc3d62da4b96284fb5ce5078560220"}
Sep 10 12:30:49.678815 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:49.678763    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4nxmq" podStartSLOduration=8.732191074 podStartE2EDuration="39.67874833s" totalImagesPullingTime="30.946557256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:49.677607858 +0000 UTC m=+40.797962434" watchObservedRunningTime="2026-09-10 12:30:49.67874833 +0000 UTC m=+40.799102906"
Sep 10 12:30:50.658202 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:50.658166    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2q87" event={"ID":"456583ce-77c9-4ee0-b771-bb8cc82efb51","Type":"ContainerStarted","Data":"e1a47df2c6976ab1ef0454280d34fc74c3c03ae5a218af342d87362cebc5605a"}
Sep 10 12:30:50.676072 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:50.676025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r2q87" podStartSLOduration=3.103734168 podStartE2EDuration="5.676010756s" totalImagesPullingTime="2.572276588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:30:50.675141623 +0000 UTC m=+41.795496200" watchObservedRunningTime="2026-09-10 12:30:50.676010756 +0000 UTC m=+41.796365332"
Sep 10 12:30:53.044127 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:53.044088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:30:53.044494 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:30:53.044168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:30:53.044494 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:53.044257    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:30:53.044494 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:53.044278    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:30:53.044494 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:53.044289    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:30:53.044494 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:53.044321    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:31:01.044306107 +0000 UTC m=+52.164660662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:30:53.044494 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:30:53.044335    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:31:01.044329414 +0000 UTC m=+52.164683969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:31:01.099479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:01.099438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:31:01.099970 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:01.099510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:31:01.099970 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:01.099559    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:31:01.099970 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:01.099582    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:31:01.099970 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:01.099636    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:31:01.099970 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:01.099639    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:31:17.099621839 +0000 UTC m=+68.219976395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:31:01.099970 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:01.099698    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:31:17.099682371 +0000 UTC m=+68.220036933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:31:10.626922 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:10.626896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mhg7"
Sep 10 12:31:15.099567 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.099514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:31:15.099567 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.099578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:31:15.102673 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.102655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 12:31:15.102728 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.102657    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 12:31:15.112591 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.112573    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 12:31:15.113409 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.113386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70159bb-bbec-4946-b9aa-9e5a61d3a847-original-pull-secret\") pod \"global-pull-secret-syncer-rnjkw\" (UID: \"b70159bb-bbec-4946-b9aa-9e5a61d3a847\") " pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:31:15.122830 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.122802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn46n\" (UniqueName: \"kubernetes.io/projected/ef90dd25-25a9-4ad0-9967-bf1bd60532fb-kube-api-access-jn46n\") pod \"network-check-target-ggg7m\" (UID: \"ef90dd25-25a9-4ad0-9967-bf1bd60532fb\") " pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:31:15.200683 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.200644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:31:15.203617 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.203598    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ll527\""
Sep 10 12:31:15.203681 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.203629    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 12:31:15.210903 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:15.210883    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 12:31:15.210987 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.210912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:31:15.210987 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:15.210933    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs podName:1c671f46-e4ff-488f-bbbb-bf831571ff80 nodeName:}" failed. No retries permitted until 2026-09-10 12:32:19.210918697 +0000 UTC m=+130.331273252 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs") pod "network-metrics-daemon-8lpqz" (UID: "1c671f46-e4ff-488f-bbbb-bf831571ff80") : secret "metrics-daemon-secret" not found
Sep 10 12:31:15.402351 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.402275    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnjkw"
Sep 10 12:31:15.487472 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.487402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggg7m"]
Sep 10 12:31:15.491570 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:31:15.491543    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef90dd25_25a9_4ad0_9967_bf1bd60532fb.slice/crio-67f0c91374d26a6be1c6d415aa011c9c0950d4232c7bb0373db4dcfbc3a129c4 WatchSource:0}: Error finding container 67f0c91374d26a6be1c6d415aa011c9c0950d4232c7bb0373db4dcfbc3a129c4: Status 404 returned error can't find the container with id 67f0c91374d26a6be1c6d415aa011c9c0950d4232c7bb0373db4dcfbc3a129c4
Sep 10 12:31:15.668763 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.668689    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnjkw"]
Sep 10 12:31:15.671547 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:31:15.671519    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70159bb_bbec_4946_b9aa_9e5a61d3a847.slice/crio-57783bf2e8c1bdab3e4a6f1ee7a1fef5030a394539566c55b98a27e965d99689 WatchSource:0}: Error finding container 57783bf2e8c1bdab3e4a6f1ee7a1fef5030a394539566c55b98a27e965d99689: Status 404 returned error can't find the container with id 57783bf2e8c1bdab3e4a6f1ee7a1fef5030a394539566c55b98a27e965d99689
Sep 10 12:31:15.718061 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.718026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnjkw" event={"ID":"b70159bb-bbec-4946-b9aa-9e5a61d3a847","Type":"ContainerStarted","Data":"57783bf2e8c1bdab3e4a6f1ee7a1fef5030a394539566c55b98a27e965d99689"}
Sep 10 12:31:15.719138 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:15.719117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggg7m" event={"ID":"ef90dd25-25a9-4ad0-9967-bf1bd60532fb","Type":"ContainerStarted","Data":"67f0c91374d26a6be1c6d415aa011c9c0950d4232c7bb0373db4dcfbc3a129c4"}
Sep 10 12:31:17.114382 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:17.114343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:31:17.114788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:17.114420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:31:17.114788 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:17.114525    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:31:17.114788 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:17.114525    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:31:17.114788 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:17.114536    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:31:17.114788 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:17.114611    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:31:49.114597459 +0000 UTC m=+100.234952014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:31:17.114788 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:17.114624    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:31:49.114618135 +0000 UTC m=+100.234972689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:31:20.734337 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:20.734305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnjkw" event={"ID":"b70159bb-bbec-4946-b9aa-9e5a61d3a847","Type":"ContainerStarted","Data":"5209a302d63565ee0c59a62221a0f8646b89a4edfb922b417e388f83e7e5ff27"}
Sep 10 12:31:20.735974 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:20.735938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggg7m" event={"ID":"ef90dd25-25a9-4ad0-9967-bf1bd60532fb","Type":"ContainerStarted","Data":"c039050f41f26bd118f2214559d87574ef547ab6f67b1db0e533defa333575d8"}
Sep 10 12:31:20.736087 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:20.736071    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:31:20.751423 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:20.751371    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rnjkw" podStartSLOduration=65.843464193 podStartE2EDuration="1m10.751352368s" totalImagesPullingTime="4.907888175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:31:20.750342276 +0000 UTC m=+71.870696853" watchObservedRunningTime="2026-09-10 12:31:20.751352368 +0000 UTC m=+71.871706948"
Sep 10 12:31:20.766684 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:20.766633    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ggg7m" podStartSLOduration=65.690524519 podStartE2EDuration="1m10.766617487s" totalImagesPullingTime="5.076092968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:31:20.765260261 +0000 UTC m=+71.885614837" watchObservedRunningTime="2026-09-10 12:31:20.766617487 +0000 UTC m=+71.886972064"
Sep 10 12:31:41.558325 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.558178    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pl9sc"]
Sep 10 12:31:41.562277 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.562257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.565014 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.564994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8kp5q\""
Sep 10 12:31:41.565299 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.565281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 12:31:41.568631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.568543    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 12:31:41.569448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.569425    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 12:31:41.570252 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.570231    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 12:31:41.572690 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.572671    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 12:31:41.577438 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.577411    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pl9sc"]
Sep 10 12:31:41.679402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.679361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f601840-4af3-412b-b97b-8111a7b8a4a6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.679402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.679403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f601840-4af3-412b-b97b-8111a7b8a4a6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.679636 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.679428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd8gs\" (UniqueName: \"kubernetes.io/projected/8f601840-4af3-412b-b97b-8111a7b8a4a6-kube-api-access-pd8gs\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.679636 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.679482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f601840-4af3-412b-b97b-8111a7b8a4a6-serving-cert\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.679636 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.679511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f601840-4af3-412b-b97b-8111a7b8a4a6-tmp\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.679636 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.679620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8f601840-4af3-412b-b97b-8111a7b8a4a6-snapshots\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.779990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.779955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f601840-4af3-412b-b97b-8111a7b8a4a6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.779990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.779990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f601840-4af3-412b-b97b-8111a7b8a4a6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.780288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.780006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd8gs\" (UniqueName: \"kubernetes.io/projected/8f601840-4af3-412b-b97b-8111a7b8a4a6-kube-api-access-pd8gs\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.780288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.780041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f601840-4af3-412b-b97b-8111a7b8a4a6-serving-cert\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.780288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.780068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f601840-4af3-412b-b97b-8111a7b8a4a6-tmp\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.780288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.780152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8f601840-4af3-412b-b97b-8111a7b8a4a6-snapshots\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.780700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.780677    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f601840-4af3-412b-b97b-8111a7b8a4a6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.780793 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.780744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f601840-4af3-412b-b97b-8111a7b8a4a6-tmp\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.780846 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.780820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8f601840-4af3-412b-b97b-8111a7b8a4a6-snapshots\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.781104 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.781083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f601840-4af3-412b-b97b-8111a7b8a4a6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.782518 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.782502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f601840-4af3-412b-b97b-8111a7b8a4a6-serving-cert\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.790175 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.790146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd8gs\" (UniqueName: \"kubernetes.io/projected/8f601840-4af3-412b-b97b-8111a7b8a4a6-kube-api-access-pd8gs\") pod \"insights-operator-76bcd6ccf5-pl9sc\" (UID: \"8f601840-4af3-412b-b97b-8111a7b8a4a6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:41.871554 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:41.871459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc"
Sep 10 12:31:42.141432 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:42.141354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pl9sc"]
Sep 10 12:31:42.145170 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:31:42.145132    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f601840_4af3_412b_b97b_8111a7b8a4a6.slice/crio-3abb40f9abb600dc61f70a06d802f507ad2a711de412766dd37065ab509c8943 WatchSource:0}: Error finding container 3abb40f9abb600dc61f70a06d802f507ad2a711de412766dd37065ab509c8943: Status 404 returned error can't find the container with id 3abb40f9abb600dc61f70a06d802f507ad2a711de412766dd37065ab509c8943
Sep 10 12:31:42.791938 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:42.791898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc" event={"ID":"8f601840-4af3-412b-b97b-8111a7b8a4a6","Type":"ContainerStarted","Data":"3abb40f9abb600dc61f70a06d802f507ad2a711de412766dd37065ab509c8943"}
Sep 10 12:31:43.920297 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:43.920264    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vh77w"]
Sep 10 12:31:43.922901 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:43.922881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w"
Sep 10 12:31:43.925652 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:43.925629    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p8lmk\""
Sep 10 12:31:43.934069 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:43.934049    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vh77w"]
Sep 10 12:31:43.995101 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:43.995078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6jh\" (UniqueName: \"kubernetes.io/projected/f55e1c82-a029-47df-a261-207d948a3339-kube-api-access-vc6jh\") pod \"network-check-source-685456655f-vh77w\" (UID: \"f55e1c82-a029-47df-a261-207d948a3339\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w"
Sep 10 12:31:44.096390 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.096348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6jh\" (UniqueName: \"kubernetes.io/projected/f55e1c82-a029-47df-a261-207d948a3339-kube-api-access-vc6jh\") pod \"network-check-source-685456655f-vh77w\" (UID: \"f55e1c82-a029-47df-a261-207d948a3339\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w"
Sep 10 12:31:44.105425 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.105393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6jh\" (UniqueName: \"kubernetes.io/projected/f55e1c82-a029-47df-a261-207d948a3339-kube-api-access-vc6jh\") pod \"network-check-source-685456655f-vh77w\" (UID: \"f55e1c82-a029-47df-a261-207d948a3339\") " pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w"
Sep 10 12:31:44.232316 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.232292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w"
Sep 10 12:31:44.508760 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.508738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-vh77w"]
Sep 10 12:31:44.511430 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:31:44.511399    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55e1c82_a029_47df_a261_207d948a3339.slice/crio-2d2099a0d1dd71c9ec6d163f5dd7dfcd706b0a49bd7a6a804d4a3d4dbb5ddc4f WatchSource:0}: Error finding container 2d2099a0d1dd71c9ec6d163f5dd7dfcd706b0a49bd7a6a804d4a3d4dbb5ddc4f: Status 404 returned error can't find the container with id 2d2099a0d1dd71c9ec6d163f5dd7dfcd706b0a49bd7a6a804d4a3d4dbb5ddc4f
Sep 10 12:31:44.799250 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.799141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w" event={"ID":"f55e1c82-a029-47df-a261-207d948a3339","Type":"ContainerStarted","Data":"b0f21b4c6db1dcd00a3eef3c9f843eb67e3ea2538526c741c54712da2df7d5a2"}
Sep 10 12:31:44.799421 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.799260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w" event={"ID":"f55e1c82-a029-47df-a261-207d948a3339","Type":"ContainerStarted","Data":"2d2099a0d1dd71c9ec6d163f5dd7dfcd706b0a49bd7a6a804d4a3d4dbb5ddc4f"}
Sep 10 12:31:44.800915 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.800884    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc" event={"ID":"8f601840-4af3-412b-b97b-8111a7b8a4a6","Type":"ContainerStarted","Data":"db37c28c9470a67df98009f6176433489e6cf41211be98ebc4f0dc0016414ec0"}
Sep 10 12:31:44.819444 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.819398    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-vh77w" podStartSLOduration=1.8193834789999999 podStartE2EDuration="1.819383479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:31:44.818407694 +0000 UTC m=+95.938762287" watchObservedRunningTime="2026-09-10 12:31:44.819383479 +0000 UTC m=+95.939738052"
Sep 10 12:31:44.845498 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:44.845453    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc" podStartSLOduration=2.0480333 podStartE2EDuration="3.845435641s" totalImagesPullingTime="1.797402341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:31:44.84387804 +0000 UTC m=+95.964232617" watchObservedRunningTime="2026-09-10 12:31:44.845435641 +0000 UTC m=+95.965790217"
Sep 10 12:31:45.621648 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.621613    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dx6tl"]
Sep 10 12:31:45.625095 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.625062    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.627643 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.627621    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 12:31:45.627907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.627888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 12:31:45.627997 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.627968    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qvkkn\""
Sep 10 12:31:45.646594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.646567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dx6tl"]
Sep 10 12:31:45.711419 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.711387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.711600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.711439    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67734282-79f6-4cd4-a7fe-2b99faea294f-crio-socket\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.711600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.711467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7tn\" (UniqueName: \"kubernetes.io/projected/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-api-access-ff7tn\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.711600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.711513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.711600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.711586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67734282-79f6-4cd4-a7fe-2b99faea294f-data-volume\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.811952 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.811923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7tn\" (UniqueName: \"kubernetes.io/projected/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-api-access-ff7tn\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.812126 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.811966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.812126 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.812002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67734282-79f6-4cd4-a7fe-2b99faea294f-data-volume\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.812126 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.812021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.812126 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.812045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67734282-79f6-4cd4-a7fe-2b99faea294f-crio-socket\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.812126 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:45.812068    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 12:31:45.812126 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.812120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67734282-79f6-4cd4-a7fe-2b99faea294f-crio-socket\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.812442 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:45.812143    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:46.312122369 +0000 UTC m=+97.432476938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : configmap "kube-rbac-proxy" not found
Sep 10 12:31:45.812442 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:45.812167    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:45.812442 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:45.812236    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:46.312202645 +0000 UTC m=+97.432557201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:45.812442 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.812370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67734282-79f6-4cd4-a7fe-2b99faea294f-data-volume\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:45.827573 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:45.827550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7tn\" (UniqueName: \"kubernetes.io/projected/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-api-access-ff7tn\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:46.315055 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:46.315012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:46.315260 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:46.315074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:46.315260 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:46.315138    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 12:31:46.315260 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:46.315175    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:46.315260 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:46.315198    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:47.315183614 +0000 UTC m=+98.435538170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : configmap "kube-rbac-proxy" not found
Sep 10 12:31:46.315260 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:46.315240    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:47.315205657 +0000 UTC m=+98.435560212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:47.323246 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:47.323182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:47.323641 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:47.323279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:47.323641 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:47.323318    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 12:31:47.323641 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:47.323388    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:49.323372486 +0000 UTC m=+100.443727041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : configmap "kube-rbac-proxy" not found
Sep 10 12:31:47.323641 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:47.323394    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:47.323641 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:47.323433    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:49.323421751 +0000 UTC m=+100.443776306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:48.138530 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:48.138499    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54nhs_33d8dbaa-f07e-413b-b890-2e2d1558c504/dns-node-resolver/0.log"
Sep 10 12:31:49.137161 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:49.137082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:31:49.137161 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:49.137161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") pod \"image-registry-6d99755df-294d4\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") " pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:31:49.137718 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.137239    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 12:31:49.137718 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.137261    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 12:31:49.137718 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.137275    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d99755df-294d4: secret "image-registry-tls" not found
Sep 10 12:31:49.137718 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.137304    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls podName:3cbfec41-74aa-4b2d-9f78-7403b3630669 nodeName:}" failed. No retries permitted until 2026-09-10 12:32:53.137287811 +0000 UTC m=+164.257642383 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls") pod "dns-default-dcsnd" (UID: "3cbfec41-74aa-4b2d-9f78-7403b3630669") : secret "dns-default-metrics-tls" not found
Sep 10 12:31:49.137718 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.137326    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls podName:3e2e7e5c-8afb-4109-9d94-06a7b492d06d nodeName:}" failed. No retries permitted until 2026-09-10 12:32:53.137310712 +0000 UTC m=+164.257665290 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls") pod "image-registry-6d99755df-294d4" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d") : secret "image-registry-tls" not found
Sep 10 12:31:49.137898 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:49.137837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nwfn_ea64abff-11bc-4017-a4bc-a743c0bfaa58/node-ca/0.log"
Sep 10 12:31:49.339052 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:49.339017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:49.339224 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:49.339081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:49.339224 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.339153    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 12:31:49.339297 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.339206    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:49.339297 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.339235    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:53.339201816 +0000 UTC m=+104.459556372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : configmap "kube-rbac-proxy" not found
Sep 10 12:31:49.339297 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:49.339272    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:31:53.339256592 +0000 UTC m=+104.459611151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:50.138432 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:50.138400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r2q87_456583ce-77c9-4ee0-b771-bb8cc82efb51/serve-healthcheck-canary/0.log"
Sep 10 12:31:51.740643 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:51.740607    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ggg7m"
Sep 10 12:31:53.372408 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:53.372370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:53.372923 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:31:53.372448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:31:53.372923 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:53.372522    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 12:31:53.372923 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:53.372551    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 12:31:53.372923 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:53.372602    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:32:01.372585971 +0000 UTC m=+112.492940526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : configmap "kube-rbac-proxy" not found
Sep 10 12:31:53.372923 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:31:53.372616    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls podName:67734282-79f6-4cd4-a7fe-2b99faea294f nodeName:}" failed. No retries permitted until 2026-09-10 12:32:01.37261038 +0000 UTC m=+112.492964934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dx6tl" (UID: "67734282-79f6-4cd4-a7fe-2b99faea294f") : secret "insights-runtime-extractor-tls" not found
Sep 10 12:32:01.436326 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:01.436293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:32:01.436703 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:01.436359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:32:01.436801 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:01.436784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67734282-79f6-4cd4-a7fe-2b99faea294f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:32:01.438685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:01.438663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67734282-79f6-4cd4-a7fe-2b99faea294f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dx6tl\" (UID: \"67734282-79f6-4cd4-a7fe-2b99faea294f\") " pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:32:01.535113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:01.535073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dx6tl"
Sep 10 12:32:01.808399 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:01.808351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dx6tl"]
Sep 10 12:32:01.811431 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:32:01.811403    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67734282_79f6_4cd4_a7fe_2b99faea294f.slice/crio-50b7fc86e621867d29ab9255bf174f5a2d7a312225a169bf9dd2cb1bac7f7a78 WatchSource:0}: Error finding container 50b7fc86e621867d29ab9255bf174f5a2d7a312225a169bf9dd2cb1bac7f7a78: Status 404 returned error can't find the container with id 50b7fc86e621867d29ab9255bf174f5a2d7a312225a169bf9dd2cb1bac7f7a78
Sep 10 12:32:01.845154 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:01.845122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dx6tl" event={"ID":"67734282-79f6-4cd4-a7fe-2b99faea294f","Type":"ContainerStarted","Data":"50b7fc86e621867d29ab9255bf174f5a2d7a312225a169bf9dd2cb1bac7f7a78"}
Sep 10 12:32:02.850377 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:02.850341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dx6tl" event={"ID":"67734282-79f6-4cd4-a7fe-2b99faea294f","Type":"ContainerStarted","Data":"82e92e96bb65eeeb71adc07406b0d9f7bd1e59d3bd40e31d40a46dcc93fc2383"}
Sep 10 12:32:03.856343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:03.856300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dx6tl" event={"ID":"67734282-79f6-4cd4-a7fe-2b99faea294f","Type":"ContainerStarted","Data":"cf004aacfad0835b9ab24fbda84248062e13852324607b63c6f9eb33725b18b3"}
Sep 10 12:32:04.862471 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:04.862376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dx6tl" event={"ID":"67734282-79f6-4cd4-a7fe-2b99faea294f","Type":"ContainerStarted","Data":"ccd7a9d86a6d80b935257c3dbbc0e7328226ded5ed0c594742a236f77dc7f400"}
Sep 10 12:32:04.887256 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:04.887193    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dx6tl" podStartSLOduration=17.29567888 podStartE2EDuration="19.887180013s" totalImagesPullingTime="2.591501133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:31:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:04.885924952 +0000 UTC m=+116.006279530" watchObservedRunningTime="2026-09-10 12:32:04.887180013 +0000 UTC m=+116.007534590"
Sep 10 12:32:10.253963 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.253932    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"]
Sep 10 12:32:10.256966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.256950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.259826 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.259805    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 12:32:10.260934 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.260915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 12:32:10.262403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.262385    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xljfb\""
Sep 10 12:32:10.262504 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.262405    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 12:32:10.262983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.262962    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 12:32:10.292187 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.292163    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"]
Sep 10 12:32:10.295079 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.295058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.295985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.295962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"]
Sep 10 12:32:10.298638 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.298615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 12:32:10.299341 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.299322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 12:32:10.300278 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.300261    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 12:32:10.300576 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.300314    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 12:32:10.341708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.341675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"]
Sep 10 12:32:10.404668 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8vv2\" (UniqueName: \"kubernetes.io/projected/1df096eb-8464-42f9-be6a-dcfffea45dc8-kube-api-access-l8vv2\") pod \"managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l\" (UID: \"1df096eb-8464-42f9-be6a-dcfffea45dc8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.404838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.404838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.404838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ba8c4c-c000-4884-8118-5c52d1108b9d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.404838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-ca\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.404975 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-hub\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.404975 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkl6l\" (UniqueName: \"kubernetes.io/projected/28ba8c4c-c000-4884-8118-5c52d1108b9d-kube-api-access-jkl6l\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.404975 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.404907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1df096eb-8464-42f9-be6a-dcfffea45dc8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l\" (UID: \"1df096eb-8464-42f9-be6a-dcfffea45dc8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.505482 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.505482 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.505709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ba8c4c-c000-4884-8118-5c52d1108b9d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.505709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-ca\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.505709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-hub\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.505709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl6l\" (UniqueName: \"kubernetes.io/projected/28ba8c4c-c000-4884-8118-5c52d1108b9d-kube-api-access-jkl6l\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.505914 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1df096eb-8464-42f9-be6a-dcfffea45dc8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l\" (UID: \"1df096eb-8464-42f9-be6a-dcfffea45dc8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.505914 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.505782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8vv2\" (UniqueName: \"kubernetes.io/projected/1df096eb-8464-42f9-be6a-dcfffea45dc8-kube-api-access-l8vv2\") pod \"managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l\" (UID: \"1df096eb-8464-42f9-be6a-dcfffea45dc8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.506341 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.506317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ba8c4c-c000-4884-8118-5c52d1108b9d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.508291 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.508264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.508393 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.508306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.508681 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.508663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-ca\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.508717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.508668    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/28ba8c4c-c000-4884-8118-5c52d1108b9d-hub\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.508800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.508783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1df096eb-8464-42f9-be6a-dcfffea45dc8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l\" (UID: \"1df096eb-8464-42f9-be6a-dcfffea45dc8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.542906 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.542879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8vv2\" (UniqueName: \"kubernetes.io/projected/1df096eb-8464-42f9-be6a-dcfffea45dc8-kube-api-access-l8vv2\") pod \"managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l\" (UID: \"1df096eb-8464-42f9-be6a-dcfffea45dc8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.545795 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.545774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkl6l\" (UniqueName: \"kubernetes.io/projected/28ba8c4c-c000-4884-8118-5c52d1108b9d-kube-api-access-jkl6l\") pod \"cluster-proxy-proxy-agent-66d6c68b89-2tvtn\" (UID: \"28ba8c4c-c000-4884-8118-5c52d1108b9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.576028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.575995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"
Sep 10 12:32:10.604803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.604772    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"
Sep 10 12:32:10.880927 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.880844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l"]
Sep 10 12:32:10.890351 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:32:10.890324    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1df096eb_8464_42f9_be6a_dcfffea45dc8.slice/crio-0395d4c85da9b74b91c9b6fee7e980733af70d4cab6c7299d868eaf41de25c91 WatchSource:0}: Error finding container 0395d4c85da9b74b91c9b6fee7e980733af70d4cab6c7299d868eaf41de25c91: Status 404 returned error can't find the container with id 0395d4c85da9b74b91c9b6fee7e980733af70d4cab6c7299d868eaf41de25c91
Sep 10 12:32:10.904545 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:10.904517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn"]
Sep 10 12:32:10.906866 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:32:10.906847    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28ba8c4c_c000_4884_8118_5c52d1108b9d.slice/crio-8a0094e22ae40915b80de8e93cb24243e2b8c7a790c6c1cf60f8462bf5b4ee2e WatchSource:0}: Error finding container 8a0094e22ae40915b80de8e93cb24243e2b8c7a790c6c1cf60f8462bf5b4ee2e: Status 404 returned error can't find the container with id 8a0094e22ae40915b80de8e93cb24243e2b8c7a790c6c1cf60f8462bf5b4ee2e
Sep 10 12:32:11.888506 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:11.888468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn" event={"ID":"28ba8c4c-c000-4884-8118-5c52d1108b9d","Type":"ContainerStarted","Data":"8a0094e22ae40915b80de8e93cb24243e2b8c7a790c6c1cf60f8462bf5b4ee2e"}
Sep 10 12:32:11.889813 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:11.889752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l" event={"ID":"1df096eb-8464-42f9-be6a-dcfffea45dc8","Type":"ContainerStarted","Data":"0395d4c85da9b74b91c9b6fee7e980733af70d4cab6c7299d868eaf41de25c91"}
Sep 10 12:32:13.898534 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:13.898504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l" event={"ID":"1df096eb-8464-42f9-be6a-dcfffea45dc8","Type":"ContainerStarted","Data":"a6f4435dd47ad10a491c4e3b47f7f12e8e7fa42b8044b93401dc1781ba5bd67e"}
Sep 10 12:32:13.941265 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:13.941192    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c68bdb4c6-dbl2l" podStartSLOduration=1.566493108 podStartE2EDuration="3.941174538s" totalImagesPullingTime="2.37468143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:13.939652518 +0000 UTC m=+125.060007094" watchObservedRunningTime="2026-09-10 12:32:13.941174538 +0000 UTC m=+125.061529114"
Sep 10 12:32:19.276040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:19.275995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:32:19.278767 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:19.278731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c671f46-e4ff-488f-bbbb-bf831571ff80-metrics-certs\") pod \"network-metrics-daemon-8lpqz\" (UID: \"1c671f46-e4ff-488f-bbbb-bf831571ff80\") " pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:32:19.310068 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:19.310032    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sz48d\""
Sep 10 12:32:19.317075 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:19.317048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lpqz"
Sep 10 12:32:20.542172 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:20.542088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8lpqz"]
Sep 10 12:32:20.546263 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:32:20.546241    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c671f46_e4ff_488f_bbbb_bf831571ff80.slice/crio-11751e093ba80621ff8121813788c4064e849061252de0679278346073c35027 WatchSource:0}: Error finding container 11751e093ba80621ff8121813788c4064e849061252de0679278346073c35027: Status 404 returned error can't find the container with id 11751e093ba80621ff8121813788c4064e849061252de0679278346073c35027
Sep 10 12:32:20.926120 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:20.926022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8lpqz" event={"ID":"1c671f46-e4ff-488f-bbbb-bf831571ff80","Type":"ContainerStarted","Data":"11751e093ba80621ff8121813788c4064e849061252de0679278346073c35027"}
Sep 10 12:32:20.927986 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:20.927962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn" event={"ID":"28ba8c4c-c000-4884-8118-5c52d1108b9d","Type":"ContainerStarted","Data":"71d13fb90c0c9ad1a1d5b7123fc07798ea58517f7541bd430681b999861c42cf"}
Sep 10 12:32:20.928113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:20.928006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn" event={"ID":"28ba8c4c-c000-4884-8118-5c52d1108b9d","Type":"ContainerStarted","Data":"2314d9616a3b9c959a30b57fb9d28428e6614b62a1e521dce4dd7a4a43ecebaa"}
Sep 10 12:32:20.928113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:20.928021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn" event={"ID":"28ba8c4c-c000-4884-8118-5c52d1108b9d","Type":"ContainerStarted","Data":"1678b5507e7dd1b5606248c850346d58e23b93b5d9271542abfcffae4e085833"}
Sep 10 12:32:20.954782 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:20.954737    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66d6c68b89-2tvtn" podStartSLOduration=1.5232819869999998 podStartE2EDuration="10.954722866s" totalImagesPullingTime="9.431440879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:20.953805317 +0000 UTC m=+132.074159895" watchObservedRunningTime="2026-09-10 12:32:20.954722866 +0000 UTC m=+132.075077502"
Sep 10 12:32:21.933528 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:21.933441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8lpqz" event={"ID":"1c671f46-e4ff-488f-bbbb-bf831571ff80","Type":"ContainerStarted","Data":"c77eb47a90867e3bc1baf7fb08360d5119084652da84f56c0b9284ce1cd7a418"}
Sep 10 12:32:21.933528 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:21.933491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8lpqz" event={"ID":"1c671f46-e4ff-488f-bbbb-bf831571ff80","Type":"ContainerStarted","Data":"4484b6b3c3eb780f6feed07d233201a21db9917c7c03ef263580d100a7975eca"}
Sep 10 12:32:21.954723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:21.954671    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8lpqz" podStartSLOduration=130.886609299 podStartE2EDuration="2m11.954656692s" totalImagesPullingTime="1.068047393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:21.953817606 +0000 UTC m=+133.074172183" watchObservedRunningTime="2026-09-10 12:32:21.954656692 +0000 UTC m=+133.075011269"
Sep 10 12:32:26.556931 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.556897    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hvs26"]
Sep 10 12:32:26.560021 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.560001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.563349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.563326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dxq69\""
Sep 10 12:32:26.563485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.563464    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 12:32:26.563548 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.563474    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 12:32:26.564237 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.564205    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 12:32:26.564411 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.564393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 12:32:26.564473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.564395    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 12:32:26.564473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.564437    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 12:32:26.631798 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-sys\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.631946 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.631946 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d48901e4-37c7-4770-92be-f89c806dc979-metrics-client-ca\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.631946 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-tls\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.631946 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-textfile\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.632087 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-accelerators-collector-config\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.632087 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-root\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.632087 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.631997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-wtmp\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.632087 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.632055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5vdm\" (UniqueName: \"kubernetes.io/projected/d48901e4-37c7-4770-92be-f89c806dc979-kube-api-access-k5vdm\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.732545 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5vdm\" (UniqueName: \"kubernetes.io/projected/d48901e4-37c7-4770-92be-f89c806dc979-kube-api-access-k5vdm\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.732700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-sys\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.732700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.732700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d48901e4-37c7-4770-92be-f89c806dc979-metrics-client-ca\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.732700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-tls\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.732700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-textfile\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.732700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-accelerators-collector-config\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-root\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-sys\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-wtmp\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-root\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.732852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-wtmp\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733084 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:32:26.732969    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 12:32:26.733084 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:32:26.733042    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-tls podName:d48901e4-37c7-4770-92be-f89c806dc979 nodeName:}" failed. No retries permitted until 2026-09-10 12:32:27.23302027 +0000 UTC m=+138.353374826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-tls") pod "node-exporter-hvs26" (UID: "d48901e4-37c7-4770-92be-f89c806dc979") : secret "node-exporter-tls" not found
Sep 10 12:32:26.733371 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.733158    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-textfile\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733371 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.733241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d48901e4-37c7-4770-92be-f89c806dc979-metrics-client-ca\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.733371 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.733338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-accelerators-collector-config\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.735168 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.735145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:26.742816 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:26.742783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5vdm\" (UniqueName: \"kubernetes.io/projected/d48901e4-37c7-4770-92be-f89c806dc979-kube-api-access-k5vdm\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:27.236422 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:27.236376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-tls\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:27.238769 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:27.238746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d48901e4-37c7-4770-92be-f89c806dc979-node-exporter-tls\") pod \"node-exporter-hvs26\" (UID: \"d48901e4-37c7-4770-92be-f89c806dc979\") " pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:27.469357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:27.469326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hvs26"
Sep 10 12:32:27.480276 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:32:27.480249    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48901e4_37c7_4770_92be_f89c806dc979.slice/crio-317278c1447df27825953ccd3f0ea560d84d75aae6f4d0a6cae6db76f196fc6f WatchSource:0}: Error finding container 317278c1447df27825953ccd3f0ea560d84d75aae6f4d0a6cae6db76f196fc6f: Status 404 returned error can't find the container with id 317278c1447df27825953ccd3f0ea560d84d75aae6f4d0a6cae6db76f196fc6f
Sep 10 12:32:27.954605 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:27.954572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvs26" event={"ID":"d48901e4-37c7-4770-92be-f89c806dc979","Type":"ContainerStarted","Data":"317278c1447df27825953ccd3f0ea560d84d75aae6f4d0a6cae6db76f196fc6f"}
Sep 10 12:32:28.959439 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:28.959399    2565 generic.go:356] "Generic (PLEG): container finished" podID="d48901e4-37c7-4770-92be-f89c806dc979" containerID="797953f386462c3f6974bf1497d3b30076275ad03a2b042ec83d2a8140c7020a" exitCode=0
Sep 10 12:32:28.959823 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:28.959489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvs26" event={"ID":"d48901e4-37c7-4770-92be-f89c806dc979","Type":"ContainerDied","Data":"797953f386462c3f6974bf1497d3b30076275ad03a2b042ec83d2a8140c7020a"}
Sep 10 12:32:29.964934 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:29.964899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvs26" event={"ID":"d48901e4-37c7-4770-92be-f89c806dc979","Type":"ContainerStarted","Data":"b4615523eec4297b89375608febb3c62799e131830b708368438e3f71d719aba"}
Sep 10 12:32:29.965420 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:29.964948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvs26" event={"ID":"d48901e4-37c7-4770-92be-f89c806dc979","Type":"ContainerStarted","Data":"68400e1decd89becec0477be754a3986d62d9ba62bba8624199f51f8005f8825"}
Sep 10 12:32:29.991462 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:29.991412    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hvs26" podStartSLOduration=2.959115025 podStartE2EDuration="3.991397637s" totalImagesPullingTime="962.263063ms" totalInitContainerRuntime="70.019549ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:29.98970386 +0000 UTC m=+141.110058439" watchObservedRunningTime="2026-09-10 12:32:29.991397637 +0000 UTC m=+141.111752214"
Sep 10 12:32:33.197871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:33.197835    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d99755df-294d4"]
Sep 10 12:32:33.198246 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:32:33.198031    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6d99755df-294d4" podUID="3e2e7e5c-8afb-4109-9d94-06a7b492d06d"
Sep 10 12:32:33.978032 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:33.978002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:32:33.984314 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:33.984292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:32:34.092934 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.092905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-installation-pull-secrets\") pod \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") "
Sep 10 12:32:34.092934 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.092939    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-certificates\") pod \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") "
Sep 10 12:32:34.093167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.092965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-trusted-ca\") pod \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") "
Sep 10 12:32:34.093167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.092998    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-image-registry-private-configuration\") pod \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") "
Sep 10 12:32:34.093167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.093023    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-bound-sa-token\") pod \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") "
Sep 10 12:32:34.093167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.093054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhdtf\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-kube-api-access-fhdtf\") pod \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") "
Sep 10 12:32:34.093167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.093076    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-ca-trust-extracted\") pod \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\" (UID: \"3e2e7e5c-8afb-4109-9d94-06a7b492d06d\") "
Sep 10 12:32:34.093475 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.093354    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3e2e7e5c-8afb-4109-9d94-06a7b492d06d" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:32:34.093475 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.093435    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3e2e7e5c-8afb-4109-9d94-06a7b492d06d" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:32:34.093590 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.093472    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3e2e7e5c-8afb-4109-9d94-06a7b492d06d" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:32:34.095467 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.095442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3e2e7e5c-8afb-4109-9d94-06a7b492d06d" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:32:34.095572 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.095484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-kube-api-access-fhdtf" (OuterVolumeSpecName: "kube-api-access-fhdtf") pod "3e2e7e5c-8afb-4109-9d94-06a7b492d06d" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d"). InnerVolumeSpecName "kube-api-access-fhdtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:32:34.095854 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.095833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3e2e7e5c-8afb-4109-9d94-06a7b492d06d" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:32:34.095854 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.095849    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3e2e7e5c-8afb-4109-9d94-06a7b492d06d" (UID: "3e2e7e5c-8afb-4109-9d94-06a7b492d06d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:32:34.194073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.194045    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdtf\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-kube-api-access-fhdtf\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:34.194073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.194071    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-ca-trust-extracted\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:34.194073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.194080    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-installation-pull-secrets\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:34.194326 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.194089    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-certificates\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:34.194326 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.194098    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-trusted-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:34.194326 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.194106    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-image-registry-private-configuration\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:34.194326 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.194116    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-bound-sa-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:34.980950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:34.980913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d99755df-294d4"
Sep 10 12:32:35.020767 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:35.020738    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d99755df-294d4"]
Sep 10 12:32:35.030010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:35.029986    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d99755df-294d4"]
Sep 10 12:32:35.102331 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:35.102302    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2e7e5c-8afb-4109-9d94-06a7b492d06d-registry-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:32:35.393442 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:35.393368    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e2e7e5c-8afb-4109-9d94-06a7b492d06d" path="/var/lib/kubelet/pods/3e2e7e5c-8afb-4109-9d94-06a7b492d06d/volumes"
Sep 10 12:32:37.577499 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.577456    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c5d6db78c-g6rjc"]
Sep 10 12:32:37.583431 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.583410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.587669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.587648    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 12:32:37.587797 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.587703    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 12:32:37.587797 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.587723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 12:32:37.587942 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.587927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 12:32:37.588005 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.587927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 12:32:37.588005 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.587932    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7wrxb\""
Sep 10 12:32:37.588102 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.588025    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 12:32:37.589028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.589012    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 12:32:37.592403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.592382    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 12:32:37.594825 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.594807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5d6db78c-g6rjc"]
Sep 10 12:32:37.621798 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.621771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-oauth-config\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.621935 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.621813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-serving-cert\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.621935 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.621883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-console-config\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.621935 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.621907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-trusted-ca-bundle\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.622080 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.621940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-service-ca\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.622080 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.621981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-oauth-serving-cert\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.622080 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.622070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8bsm\" (UniqueName: \"kubernetes.io/projected/4449a912-2528-4d6e-a5b6-98cf80289345-kube-api-access-p8bsm\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.722717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.722684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-oauth-config\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.722717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.722723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-serving-cert\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.722939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.722755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-console-config\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.722939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.722771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-trusted-ca-bundle\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.722939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.722795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-service-ca\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.722939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.722810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-oauth-serving-cert\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.722939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.722858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8bsm\" (UniqueName: \"kubernetes.io/projected/4449a912-2528-4d6e-a5b6-98cf80289345-kube-api-access-p8bsm\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.723612 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.723582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-console-config\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.723747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.723595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-service-ca\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.723809 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.723751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-trusted-ca-bundle\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.723860 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.723839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-oauth-serving-cert\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.725434 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.725404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-serving-cert\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.725562 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.725543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-oauth-config\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.732525 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.732505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8bsm\" (UniqueName: \"kubernetes.io/projected/4449a912-2528-4d6e-a5b6-98cf80289345-kube-api-access-p8bsm\") pod \"console-7c5d6db78c-g6rjc\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") " pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:37.893044 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:37.892961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:38.173525 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:38.173496    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5d6db78c-g6rjc"]
Sep 10 12:32:38.175612 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:32:38.175579    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4449a912_2528_4d6e_a5b6_98cf80289345.slice/crio-f1eafe6dfb322cdf342fcd72c63a4c7205a4772c9bb881295a7c923962d29ca6 WatchSource:0}: Error finding container f1eafe6dfb322cdf342fcd72c63a4c7205a4772c9bb881295a7c923962d29ca6: Status 404 returned error can't find the container with id f1eafe6dfb322cdf342fcd72c63a4c7205a4772c9bb881295a7c923962d29ca6
Sep 10 12:32:39.001485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:39.001443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5d6db78c-g6rjc" event={"ID":"4449a912-2528-4d6e-a5b6-98cf80289345","Type":"ContainerStarted","Data":"f1eafe6dfb322cdf342fcd72c63a4c7205a4772c9bb881295a7c923962d29ca6"}
Sep 10 12:32:41.010420 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:41.010334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5d6db78c-g6rjc" event={"ID":"4449a912-2528-4d6e-a5b6-98cf80289345","Type":"ContainerStarted","Data":"45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1"}
Sep 10 12:32:41.036017 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:41.035959    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c5d6db78c-g6rjc" podStartSLOduration=1.498781566 podStartE2EDuration="4.035940124s" totalImagesPullingTime="2.537158558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:41.035704727 +0000 UTC m=+152.156059305" watchObservedRunningTime="2026-09-10 12:32:41.035940124 +0000 UTC m=+152.156294701"
Sep 10 12:32:47.894031 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:47.893979    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:47.894634 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:47.894064    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:47.899899 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:47.899876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:48.037450 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:48.037423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:32:48.284984 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:32:48.284933    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dcsnd" podUID="3cbfec41-74aa-4b2d-9f78-7403b3630669"
Sep 10 12:32:49.037286 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:49.037254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:32:53.148598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:53.148550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:32:53.151018 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:53.150991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cbfec41-74aa-4b2d-9f78-7403b3630669-metrics-tls\") pod \"dns-default-dcsnd\" (UID: \"3cbfec41-74aa-4b2d-9f78-7403b3630669\") " pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:32:53.241462 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:53.241430    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgmkk\""
Sep 10 12:32:53.249027 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:53.249002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:32:53.527311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:53.527281    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dcsnd"]
Sep 10 12:32:53.530882 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:32:53.530855    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbfec41_74aa_4b2d_9f78_7403b3630669.slice/crio-c60b897561b59d5554ff31fbd40e9cc27e5c1521761cd5148f37a0125451fe01 WatchSource:0}: Error finding container c60b897561b59d5554ff31fbd40e9cc27e5c1521761cd5148f37a0125451fe01: Status 404 returned error can't find the container with id c60b897561b59d5554ff31fbd40e9cc27e5c1521761cd5148f37a0125451fe01
Sep 10 12:32:54.055611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:54.055570    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dcsnd" event={"ID":"3cbfec41-74aa-4b2d-9f78-7403b3630669","Type":"ContainerStarted","Data":"c60b897561b59d5554ff31fbd40e9cc27e5c1521761cd5148f37a0125451fe01"}
Sep 10 12:32:56.064229 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:56.064182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dcsnd" event={"ID":"3cbfec41-74aa-4b2d-9f78-7403b3630669","Type":"ContainerStarted","Data":"fb087e0902e96995de3c4c55c45447d426a78d2951a1c4de2da9631f705884cd"}
Sep 10 12:32:56.064611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:56.064254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dcsnd" event={"ID":"3cbfec41-74aa-4b2d-9f78-7403b3630669","Type":"ContainerStarted","Data":"77bafe350ccd3e510c28203084700ae72e4ea03de5a5bd608111339a4601d979"}
Sep 10 12:32:56.064611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:56.064397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:32:56.083513 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:32:56.083470    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dcsnd" podStartSLOduration=129.519426283 podStartE2EDuration="2m11.083455652s" totalImagesPullingTime="1.564029369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:56.081879595 +0000 UTC m=+167.202234171" watchObservedRunningTime="2026-09-10 12:32:56.083455652 +0000 UTC m=+167.203810267"
Sep 10 12:33:06.069089 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:33:06.069008    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dcsnd"
Sep 10 12:33:20.143512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:33:20.143428    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f601840-4af3-412b-b97b-8111a7b8a4a6" containerID="db37c28c9470a67df98009f6176433489e6cf41211be98ebc4f0dc0016414ec0" exitCode=0
Sep 10 12:33:20.143512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:33:20.143499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc" event={"ID":"8f601840-4af3-412b-b97b-8111a7b8a4a6","Type":"ContainerDied","Data":"db37c28c9470a67df98009f6176433489e6cf41211be98ebc4f0dc0016414ec0"}
Sep 10 12:33:20.143966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:33:20.143836    2565 scope.go:117] "RemoveContainer" containerID="db37c28c9470a67df98009f6176433489e6cf41211be98ebc4f0dc0016414ec0"
Sep 10 12:33:21.151658 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:33:21.151620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pl9sc" event={"ID":"8f601840-4af3-412b-b97b-8111a7b8a4a6","Type":"ContainerStarted","Data":"b80d35e7fe73c4760cadd47ea1039a7db45ce689c45c7e9a78a9467836bf9ed0"}
Sep 10 12:34:00.839723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.839692    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5dfbd4bb-zfd6b"]
Sep 10 12:34:00.842584 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.842567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:00.857554 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.857527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5dfbd4bb-zfd6b"]
Sep 10 12:34:00.929417 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.929383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-oauth-config\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:00.929417 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.929422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-serving-cert\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:00.929615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.929437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8g2p\" (UniqueName: \"kubernetes.io/projected/c5d9d762-ac7c-4958-b27f-7060d3eaf878-kube-api-access-k8g2p\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:00.929615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.929453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-oauth-serving-cert\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:00.929615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.929467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-trusted-ca-bundle\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:00.929615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.929537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-service-ca\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:00.929615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:00.929588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-config\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.030730 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.030693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-service-ca\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.030887 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.030743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-config\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.030927 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.030883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-oauth-config\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.030966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.030928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-serving-cert\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.030966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.030951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8g2p\" (UniqueName: \"kubernetes.io/projected/c5d9d762-ac7c-4958-b27f-7060d3eaf878-kube-api-access-k8g2p\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.031039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.030976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-oauth-serving-cert\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.031039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.031000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-trusted-ca-bundle\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.031510 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.031480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-config\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.031800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.031582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-service-ca\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.031800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.031755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-trusted-ca-bundle\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.031800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.031758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-oauth-serving-cert\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.033588 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.033564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-oauth-config\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.033687 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.033577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-serving-cert\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.039954 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.039929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8g2p\" (UniqueName: \"kubernetes.io/projected/c5d9d762-ac7c-4958-b27f-7060d3eaf878-kube-api-access-k8g2p\") pod \"console-6b5dfbd4bb-zfd6b\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") " pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.151244 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.151130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:01.423086 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:01.423007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5dfbd4bb-zfd6b"]
Sep 10 12:34:01.426223 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:34:01.426179    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d9d762_ac7c_4958_b27f_7060d3eaf878.slice/crio-68c6c7746c51f3d80bfb6ab416c5954c8e4cf66f3fef9441c7636cfa96a6f2f7 WatchSource:0}: Error finding container 68c6c7746c51f3d80bfb6ab416c5954c8e4cf66f3fef9441c7636cfa96a6f2f7: Status 404 returned error can't find the container with id 68c6c7746c51f3d80bfb6ab416c5954c8e4cf66f3fef9441c7636cfa96a6f2f7
Sep 10 12:34:02.300326 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:02.300287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5dfbd4bb-zfd6b" event={"ID":"c5d9d762-ac7c-4958-b27f-7060d3eaf878","Type":"ContainerStarted","Data":"31d9339e1174f477c49e1e9ca297c18ec76bbbd4ff5f95fdf82e4a2644d2b6e3"}
Sep 10 12:34:02.300805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:02.300341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5dfbd4bb-zfd6b" event={"ID":"c5d9d762-ac7c-4958-b27f-7060d3eaf878","Type":"ContainerStarted","Data":"68c6c7746c51f3d80bfb6ab416c5954c8e4cf66f3fef9441c7636cfa96a6f2f7"}
Sep 10 12:34:02.322190 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:02.322138    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b5dfbd4bb-zfd6b" podStartSLOduration=2.322119647 podStartE2EDuration="2.322119647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:34:02.321871148 +0000 UTC m=+233.442225725" watchObservedRunningTime="2026-09-10 12:34:02.322119647 +0000 UTC m=+233.442474224"
Sep 10 12:34:11.151566 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:11.151500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:11.152077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:11.151616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:11.156301 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:11.156276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:11.334060 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:11.334034    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:34:11.399749 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:11.399715    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5d6db78c-g6rjc"]
Sep 10 12:34:36.420425 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.420319    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c5d6db78c-g6rjc" podUID="4449a912-2528-4d6e-a5b6-98cf80289345" containerName="console" containerID="cri-o://45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1" gracePeriod=15
Sep 10 12:34:36.658744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.658721    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:34:36.810731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.810692    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8bsm\" (UniqueName: \"kubernetes.io/projected/4449a912-2528-4d6e-a5b6-98cf80289345-kube-api-access-p8bsm\") pod \"4449a912-2528-4d6e-a5b6-98cf80289345\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") "
Sep 10 12:34:36.810731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.810730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-oauth-config\") pod \"4449a912-2528-4d6e-a5b6-98cf80289345\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") "
Sep 10 12:34:36.810971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.810747    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-service-ca\") pod \"4449a912-2528-4d6e-a5b6-98cf80289345\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") "
Sep 10 12:34:36.810971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.810764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-trusted-ca-bundle\") pod \"4449a912-2528-4d6e-a5b6-98cf80289345\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") "
Sep 10 12:34:36.810971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.810798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-serving-cert\") pod \"4449a912-2528-4d6e-a5b6-98cf80289345\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") "
Sep 10 12:34:36.810971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.810844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-console-config\") pod \"4449a912-2528-4d6e-a5b6-98cf80289345\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") "
Sep 10 12:34:36.810971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.810863    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-oauth-serving-cert\") pod \"4449a912-2528-4d6e-a5b6-98cf80289345\" (UID: \"4449a912-2528-4d6e-a5b6-98cf80289345\") "
Sep 10 12:34:36.811283 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.811251    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-service-ca" (OuterVolumeSpecName: "service-ca") pod "4449a912-2528-4d6e-a5b6-98cf80289345" (UID: "4449a912-2528-4d6e-a5b6-98cf80289345"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:36.811349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.811282    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4449a912-2528-4d6e-a5b6-98cf80289345" (UID: "4449a912-2528-4d6e-a5b6-98cf80289345"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:36.811349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.811335    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4449a912-2528-4d6e-a5b6-98cf80289345" (UID: "4449a912-2528-4d6e-a5b6-98cf80289345"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:36.811435 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.811359    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-console-config" (OuterVolumeSpecName: "console-config") pod "4449a912-2528-4d6e-a5b6-98cf80289345" (UID: "4449a912-2528-4d6e-a5b6-98cf80289345"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:36.813343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.813309    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4449a912-2528-4d6e-a5b6-98cf80289345" (UID: "4449a912-2528-4d6e-a5b6-98cf80289345"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:34:36.813510 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.813487    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4449a912-2528-4d6e-a5b6-98cf80289345" (UID: "4449a912-2528-4d6e-a5b6-98cf80289345"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:34:36.813594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.813551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4449a912-2528-4d6e-a5b6-98cf80289345-kube-api-access-p8bsm" (OuterVolumeSpecName: "kube-api-access-p8bsm") pod "4449a912-2528-4d6e-a5b6-98cf80289345" (UID: "4449a912-2528-4d6e-a5b6-98cf80289345"). InnerVolumeSpecName "kube-api-access-p8bsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:36.911347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.911313    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-serving-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:34:36.911347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.911341    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-console-config\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:34:36.911347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.911351    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-oauth-serving-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:34:36.911570 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.911360    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8bsm\" (UniqueName: \"kubernetes.io/projected/4449a912-2528-4d6e-a5b6-98cf80289345-kube-api-access-p8bsm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:34:36.911570 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.911369    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4449a912-2528-4d6e-a5b6-98cf80289345-console-oauth-config\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:34:36.911570 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.911379    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:34:36.911570 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:36.911393    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4449a912-2528-4d6e-a5b6-98cf80289345-trusted-ca-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:34:37.417874 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.417839    2565 generic.go:356] "Generic (PLEG): container finished" podID="4449a912-2528-4d6e-a5b6-98cf80289345" containerID="45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1" exitCode=0
Sep 10 12:34:37.418028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.417890    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5d6db78c-g6rjc"
Sep 10 12:34:37.418028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.417912    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5d6db78c-g6rjc" event={"ID":"4449a912-2528-4d6e-a5b6-98cf80289345","Type":"ContainerDied","Data":"45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1"}
Sep 10 12:34:37.418028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.417957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5d6db78c-g6rjc" event={"ID":"4449a912-2528-4d6e-a5b6-98cf80289345","Type":"ContainerDied","Data":"f1eafe6dfb322cdf342fcd72c63a4c7205a4772c9bb881295a7c923962d29ca6"}
Sep 10 12:34:37.418028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.417979    2565 scope.go:117] "RemoveContainer" containerID="45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1"
Sep 10 12:34:37.425990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.425881    2565 scope.go:117] "RemoveContainer" containerID="45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1"
Sep 10 12:34:37.426378 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:34:37.426256    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1\": container with ID starting with 45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1 not found: ID does not exist" containerID="45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1"
Sep 10 12:34:37.426378 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.426286    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1"} err="failed to get container status \"45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1\": rpc error: code = NotFound desc = could not find container \"45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1\": container with ID starting with 45d70d6cfe4369362beb49f291f203386c181e1117701cfb21353842273ee0d1 not found: ID does not exist"
Sep 10 12:34:37.454959 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.454938    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5d6db78c-g6rjc"]
Sep 10 12:34:37.457923 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:37.457896    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c5d6db78c-g6rjc"]
Sep 10 12:34:39.393300 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:34:39.393267    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4449a912-2528-4d6e-a5b6-98cf80289345" path="/var/lib/kubelet/pods/4449a912-2528-4d6e-a5b6-98cf80289345/volumes"
Sep 10 12:35:00.201694 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.201659    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"]
Sep 10 12:35:00.202128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.201886    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4449a912-2528-4d6e-a5b6-98cf80289345" containerName="console"
Sep 10 12:35:00.202128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.201896    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4449a912-2528-4d6e-a5b6-98cf80289345" containerName="console"
Sep 10 12:35:00.202128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.201937    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4449a912-2528-4d6e-a5b6-98cf80289345" containerName="console"
Sep 10 12:35:00.204702 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.204685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.207874 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.207844    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:35:00.207874 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.207865    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:35:00.208825 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.208810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7hcx\""
Sep 10 12:35:00.217456 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.215885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"]
Sep 10 12:35:00.268512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.268471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cbdd\" (UniqueName: \"kubernetes.io/projected/4bd8cbef-ddac-4830-949b-c37d565f129c-kube-api-access-5cbdd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.268512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.268512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.268714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.268548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.368857 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.368816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cbdd\" (UniqueName: \"kubernetes.io/projected/4bd8cbef-ddac-4830-949b-c37d565f129c-kube-api-access-5cbdd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.368857 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.368857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.369036 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.368903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.369361 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.369339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.369405 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.369349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.378282 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.378251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cbdd\" (UniqueName: \"kubernetes.io/projected/4bd8cbef-ddac-4830-949b-c37d565f129c-kube-api-access-5cbdd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.514129 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.514043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:00.785813 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:00.785634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"]
Sep 10 12:35:00.788282 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:35:00.788246    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd8cbef_ddac_4830_949b_c37d565f129c.slice/crio-61c022a0cec0acb997192b777ab6ba4e78bda199e5e650b06a40555be5ad9ba2 WatchSource:0}: Error finding container 61c022a0cec0acb997192b777ab6ba4e78bda199e5e650b06a40555be5ad9ba2: Status 404 returned error can't find the container with id 61c022a0cec0acb997192b777ab6ba4e78bda199e5e650b06a40555be5ad9ba2
Sep 10 12:35:01.501015 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:01.500976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn" event={"ID":"4bd8cbef-ddac-4830-949b-c37d565f129c","Type":"ContainerStarted","Data":"61c022a0cec0acb997192b777ab6ba4e78bda199e5e650b06a40555be5ad9ba2"}
Sep 10 12:35:08.531609 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:08.531574    2565 generic.go:356] "Generic (PLEG): container finished" podID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerID="65b281b4e6f29bacae527cc37cc1d418425e41abd03bbc2bd98d8b6d971da4f0" exitCode=0
Sep 10 12:35:08.531971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:08.531640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn" event={"ID":"4bd8cbef-ddac-4830-949b-c37d565f129c","Type":"ContainerDied","Data":"65b281b4e6f29bacae527cc37cc1d418425e41abd03bbc2bd98d8b6d971da4f0"}
Sep 10 12:35:09.307596 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:09.307565    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 12:35:11.544867 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:11.544830    2565 generic.go:356] "Generic (PLEG): container finished" podID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerID="88313ba74b15c9c2731a6ad6887491134be32f25d5ded49283e90f54e39649df" exitCode=0
Sep 10 12:35:11.545278 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:11.544913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn" event={"ID":"4bd8cbef-ddac-4830-949b-c37d565f129c","Type":"ContainerDied","Data":"88313ba74b15c9c2731a6ad6887491134be32f25d5ded49283e90f54e39649df"}
Sep 10 12:35:11.545980 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:11.545966    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:35:18.572800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:18.572766    2565 generic.go:356] "Generic (PLEG): container finished" podID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerID="b93b1edc4d7e792ea5ccbf8bfa88db4798994add844f15feda84daf9a4347d7c" exitCode=0
Sep 10 12:35:18.573158 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:18.572841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn" event={"ID":"4bd8cbef-ddac-4830-949b-c37d565f129c","Type":"ContainerDied","Data":"b93b1edc4d7e792ea5ccbf8bfa88db4798994add844f15feda84daf9a4347d7c"}
Sep 10 12:35:19.693813 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.693790    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:19.801717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.801672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-util\") pod \"4bd8cbef-ddac-4830-949b-c37d565f129c\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") "
Sep 10 12:35:19.801895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.801743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-bundle\") pod \"4bd8cbef-ddac-4830-949b-c37d565f129c\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") "
Sep 10 12:35:19.801895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.801777    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cbdd\" (UniqueName: \"kubernetes.io/projected/4bd8cbef-ddac-4830-949b-c37d565f129c-kube-api-access-5cbdd\") pod \"4bd8cbef-ddac-4830-949b-c37d565f129c\" (UID: \"4bd8cbef-ddac-4830-949b-c37d565f129c\") "
Sep 10 12:35:19.802379 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.802345    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-bundle" (OuterVolumeSpecName: "bundle") pod "4bd8cbef-ddac-4830-949b-c37d565f129c" (UID: "4bd8cbef-ddac-4830-949b-c37d565f129c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:35:19.804087 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.804051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd8cbef-ddac-4830-949b-c37d565f129c-kube-api-access-5cbdd" (OuterVolumeSpecName: "kube-api-access-5cbdd") pod "4bd8cbef-ddac-4830-949b-c37d565f129c" (UID: "4bd8cbef-ddac-4830-949b-c37d565f129c"). InnerVolumeSpecName "kube-api-access-5cbdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:35:19.806860 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.806840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-util" (OuterVolumeSpecName: "util") pod "4bd8cbef-ddac-4830-949b-c37d565f129c" (UID: "4bd8cbef-ddac-4830-949b-c37d565f129c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:35:19.902648 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.902552    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:35:19.902648 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.902595    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cbdd\" (UniqueName: \"kubernetes.io/projected/4bd8cbef-ddac-4830-949b-c37d565f129c-kube-api-access-5cbdd\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:35:19.902648 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:19.902604    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4bd8cbef-ddac-4830-949b-c37d565f129c-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:35:20.581684 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:20.581648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn" event={"ID":"4bd8cbef-ddac-4830-949b-c37d565f129c","Type":"ContainerDied","Data":"61c022a0cec0acb997192b777ab6ba4e78bda199e5e650b06a40555be5ad9ba2"}
Sep 10 12:35:20.581684 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:20.581670    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405w4sn"
Sep 10 12:35:20.581887 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:20.581697    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61c022a0cec0acb997192b777ab6ba4e78bda199e5e650b06a40555be5ad9ba2"
Sep 10 12:35:28.430222 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430186    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"]
Sep 10 12:35:28.430700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430451    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerName="util"
Sep 10 12:35:28.430700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430462    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerName="util"
Sep 10 12:35:28.430700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430471    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerName="pull"
Sep 10 12:35:28.430700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430476    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerName="pull"
Sep 10 12:35:28.430700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430484    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerName="extract"
Sep 10 12:35:28.430700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430489    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerName="extract"
Sep 10 12:35:28.430700 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.430525    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd8cbef-ddac-4830-949b-c37d565f129c" containerName="extract"
Sep 10 12:35:28.477825 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.477795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"]
Sep 10 12:35:28.477971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.477905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:28.481514 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.481492    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 12:35:28.481514 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.481499    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:35:28.481710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.481540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5lx5v\""
Sep 10 12:35:28.564924 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.564891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q922\" (UniqueName: \"kubernetes.io/projected/4babfbc2-2f46-4f2a-845f-eb0f7c89cab4-kube-api-access-8q922\") pod \"cert-manager-operator-controller-manager-55c444bf86-nm5bj\" (UID: \"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:28.565081 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.564933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4babfbc2-2f46-4f2a-845f-eb0f7c89cab4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nm5bj\" (UID: \"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:28.665767 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.665735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q922\" (UniqueName: \"kubernetes.io/projected/4babfbc2-2f46-4f2a-845f-eb0f7c89cab4-kube-api-access-8q922\") pod \"cert-manager-operator-controller-manager-55c444bf86-nm5bj\" (UID: \"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:28.665935 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.665786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4babfbc2-2f46-4f2a-845f-eb0f7c89cab4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nm5bj\" (UID: \"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:28.666152 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.666131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4babfbc2-2f46-4f2a-845f-eb0f7c89cab4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nm5bj\" (UID: \"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:28.676060 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.676033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q922\" (UniqueName: \"kubernetes.io/projected/4babfbc2-2f46-4f2a-845f-eb0f7c89cab4-kube-api-access-8q922\") pod \"cert-manager-operator-controller-manager-55c444bf86-nm5bj\" (UID: \"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:28.787009 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:28.786980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"
Sep 10 12:35:29.084388 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:29.084362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj"]
Sep 10 12:35:29.086303 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:35:29.086275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4babfbc2_2f46_4f2a_845f_eb0f7c89cab4.slice/crio-156d499dec82ca5abdea450613e88e5c910c236d0e92c2857cfe74b7ae831f16 WatchSource:0}: Error finding container 156d499dec82ca5abdea450613e88e5c910c236d0e92c2857cfe74b7ae831f16: Status 404 returned error can't find the container with id 156d499dec82ca5abdea450613e88e5c910c236d0e92c2857cfe74b7ae831f16
Sep 10 12:35:29.611972 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:29.611934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj" event={"ID":"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4","Type":"ContainerStarted","Data":"156d499dec82ca5abdea450613e88e5c910c236d0e92c2857cfe74b7ae831f16"}
Sep 10 12:35:31.621995 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:31.621957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj" event={"ID":"4babfbc2-2f46-4f2a-845f-eb0f7c89cab4","Type":"ContainerStarted","Data":"96a17a42b753b1f08cede73e5ad36abb3fd327396c0086c26c05efacf331a00b"}
Sep 10 12:35:31.648037 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:31.647984    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nm5bj" podStartSLOduration=1.639958174 podStartE2EDuration="3.647964947s" totalImagesPullingTime="2.008006773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:35:31.645666828 +0000 UTC m=+322.766021406" watchObservedRunningTime="2026-09-10 12:35:31.647964947 +0000 UTC m=+322.768319526"
Sep 10 12:35:32.724289 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.724251    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"]
Sep 10 12:35:32.726223 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.726197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.729589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.729568    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:35:32.730223 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.730194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7hcx\""
Sep 10 12:35:32.734393 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.734377    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:35:32.753765 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.753738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"]
Sep 10 12:35:32.800271 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.800237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbmrv\" (UniqueName: \"kubernetes.io/projected/4ce80957-d69f-48c9-96be-47576788f3c2-kube-api-access-tbmrv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.800427 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.800281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.800427 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.800315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.901330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.901289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.901512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.901389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbmrv\" (UniqueName: \"kubernetes.io/projected/4ce80957-d69f-48c9-96be-47576788f3c2-kube-api-access-tbmrv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.901512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.901432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.901761 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.901741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.901818 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.901740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:32.911079 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:32.911048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbmrv\" (UniqueName: \"kubernetes.io/projected/4ce80957-d69f-48c9-96be-47576788f3c2-kube-api-access-tbmrv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:33.034784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:33.034702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:33.307310 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:33.307282    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"]
Sep 10 12:35:33.309689 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:35:33.309665    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce80957_d69f_48c9_96be_47576788f3c2.slice/crio-fa9834c6842c444c9fa1c0e415d7a3066f16f730b5876bc0b874db13c7cb819b WatchSource:0}: Error finding container fa9834c6842c444c9fa1c0e415d7a3066f16f730b5876bc0b874db13c7cb819b: Status 404 returned error can't find the container with id fa9834c6842c444c9fa1c0e415d7a3066f16f730b5876bc0b874db13c7cb819b
Sep 10 12:35:33.630485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:33.630404    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ce80957-d69f-48c9-96be-47576788f3c2" containerID="0e4435d6f0ebfe7025eff244e38a06f414ee3decc0a41475ec03d4ef94680451" exitCode=0
Sep 10 12:35:33.630485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:33.630441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9" event={"ID":"4ce80957-d69f-48c9-96be-47576788f3c2","Type":"ContainerDied","Data":"0e4435d6f0ebfe7025eff244e38a06f414ee3decc0a41475ec03d4ef94680451"}
Sep 10 12:35:33.630485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:33.630477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9" event={"ID":"4ce80957-d69f-48c9-96be-47576788f3c2","Type":"ContainerStarted","Data":"fa9834c6842c444c9fa1c0e415d7a3066f16f730b5876bc0b874db13c7cb819b"}
Sep 10 12:35:41.664933 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:41.664847    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ce80957-d69f-48c9-96be-47576788f3c2" containerID="b54af50695950bafc5dcb76681a0c4ae36697cba55eb6bab1450b2344dd9feef" exitCode=0
Sep 10 12:35:41.665322 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:41.664937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9" event={"ID":"4ce80957-d69f-48c9-96be-47576788f3c2","Type":"ContainerDied","Data":"b54af50695950bafc5dcb76681a0c4ae36697cba55eb6bab1450b2344dd9feef"}
Sep 10 12:35:42.670875 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:42.670837    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ce80957-d69f-48c9-96be-47576788f3c2" containerID="91d587be4f07833f9c553eae0dab67b11a52523e64a8a9b516756de3379130ff" exitCode=0
Sep 10 12:35:42.671264 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:42.670915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9" event={"ID":"4ce80957-d69f-48c9-96be-47576788f3c2","Type":"ContainerDied","Data":"91d587be4f07833f9c553eae0dab67b11a52523e64a8a9b516756de3379130ff"}
Sep 10 12:35:43.795746 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.795722    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:43.880515 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.880484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-util\") pod \"4ce80957-d69f-48c9-96be-47576788f3c2\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") "
Sep 10 12:35:43.880676 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.880574    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbmrv\" (UniqueName: \"kubernetes.io/projected/4ce80957-d69f-48c9-96be-47576788f3c2-kube-api-access-tbmrv\") pod \"4ce80957-d69f-48c9-96be-47576788f3c2\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") "
Sep 10 12:35:43.880676 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.880598    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-bundle\") pod \"4ce80957-d69f-48c9-96be-47576788f3c2\" (UID: \"4ce80957-d69f-48c9-96be-47576788f3c2\") "
Sep 10 12:35:43.880996 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.880973    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-bundle" (OuterVolumeSpecName: "bundle") pod "4ce80957-d69f-48c9-96be-47576788f3c2" (UID: "4ce80957-d69f-48c9-96be-47576788f3c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:35:43.882813 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.882791    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce80957-d69f-48c9-96be-47576788f3c2-kube-api-access-tbmrv" (OuterVolumeSpecName: "kube-api-access-tbmrv") pod "4ce80957-d69f-48c9-96be-47576788f3c2" (UID: "4ce80957-d69f-48c9-96be-47576788f3c2"). InnerVolumeSpecName "kube-api-access-tbmrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:35:43.885319 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.885302    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-util" (OuterVolumeSpecName: "util") pod "4ce80957-d69f-48c9-96be-47576788f3c2" (UID: "4ce80957-d69f-48c9-96be-47576788f3c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:35:43.981755 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.981731    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:35:43.981755 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.981757    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbmrv\" (UniqueName: \"kubernetes.io/projected/4ce80957-d69f-48c9-96be-47576788f3c2-kube-api-access-tbmrv\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:35:43.981939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:43.981767    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ce80957-d69f-48c9-96be-47576788f3c2-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:35:44.680709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:44.680678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9" event={"ID":"4ce80957-d69f-48c9-96be-47576788f3c2","Type":"ContainerDied","Data":"fa9834c6842c444c9fa1c0e415d7a3066f16f730b5876bc0b874db13c7cb819b"}
Sep 10 12:35:44.680871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:44.680724    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa9834c6842c444c9fa1c0e415d7a3066f16f730b5876bc0b874db13c7cb819b"
Sep 10 12:35:44.680871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:44.680689    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zgh9"
Sep 10 12:35:52.347635 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347602    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kmhgj"]
Sep 10 12:35:52.347994 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347830    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce80957-d69f-48c9-96be-47576788f3c2" containerName="extract"
Sep 10 12:35:52.347994 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347840    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce80957-d69f-48c9-96be-47576788f3c2" containerName="extract"
Sep 10 12:35:52.347994 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347851    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce80957-d69f-48c9-96be-47576788f3c2" containerName="util"
Sep 10 12:35:52.347994 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347856    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce80957-d69f-48c9-96be-47576788f3c2" containerName="util"
Sep 10 12:35:52.347994 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347868    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce80957-d69f-48c9-96be-47576788f3c2" containerName="pull"
Sep 10 12:35:52.347994 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347874    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce80957-d69f-48c9-96be-47576788f3c2" containerName="pull"
Sep 10 12:35:52.347994 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.347914    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ce80957-d69f-48c9-96be-47576788f3c2" containerName="extract"
Sep 10 12:35:52.349568 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.349552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.352385 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.352357    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 12:35:52.352510 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.352445    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8mlv7\""
Sep 10 12:35:52.353286 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.353268    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 12:35:52.359774 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.359750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kmhgj"]
Sep 10 12:35:52.438763 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.438725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mctk\" (UniqueName: \"kubernetes.io/projected/9a4488cf-c17a-401a-aa4c-c0db869b0dc9-kube-api-access-2mctk\") pod \"cert-manager-55b4d954d5-kmhgj\" (UID: \"9a4488cf-c17a-401a-aa4c-c0db869b0dc9\") " pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.438924 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.438772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a4488cf-c17a-401a-aa4c-c0db869b0dc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-kmhgj\" (UID: \"9a4488cf-c17a-401a-aa4c-c0db869b0dc9\") " pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.540178 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.540135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mctk\" (UniqueName: \"kubernetes.io/projected/9a4488cf-c17a-401a-aa4c-c0db869b0dc9-kube-api-access-2mctk\") pod \"cert-manager-55b4d954d5-kmhgj\" (UID: \"9a4488cf-c17a-401a-aa4c-c0db869b0dc9\") " pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.540403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.540193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a4488cf-c17a-401a-aa4c-c0db869b0dc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-kmhgj\" (UID: \"9a4488cf-c17a-401a-aa4c-c0db869b0dc9\") " pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.549776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.549740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a4488cf-c17a-401a-aa4c-c0db869b0dc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-kmhgj\" (UID: \"9a4488cf-c17a-401a-aa4c-c0db869b0dc9\") " pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.549895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.549809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mctk\" (UniqueName: \"kubernetes.io/projected/9a4488cf-c17a-401a-aa4c-c0db869b0dc9-kube-api-access-2mctk\") pod \"cert-manager-55b4d954d5-kmhgj\" (UID: \"9a4488cf-c17a-401a-aa4c-c0db869b0dc9\") " pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.658806 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.658718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kmhgj"
Sep 10 12:35:52.927788 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:52.927760    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kmhgj"]
Sep 10 12:35:52.930187 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:35:52.930156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a4488cf_c17a_401a_aa4c_c0db869b0dc9.slice/crio-aecdc71551ba0ebd82c9e47b7115df17eacf1af08a60958b0cbee0302285ba7b WatchSource:0}: Error finding container aecdc71551ba0ebd82c9e47b7115df17eacf1af08a60958b0cbee0302285ba7b: Status 404 returned error can't find the container with id aecdc71551ba0ebd82c9e47b7115df17eacf1af08a60958b0cbee0302285ba7b
Sep 10 12:35:53.717122 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:53.717086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kmhgj" event={"ID":"9a4488cf-c17a-401a-aa4c-c0db869b0dc9","Type":"ContainerStarted","Data":"aecdc71551ba0ebd82c9e47b7115df17eacf1af08a60958b0cbee0302285ba7b"}
Sep 10 12:35:55.727819 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:55.727784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kmhgj" event={"ID":"9a4488cf-c17a-401a-aa4c-c0db869b0dc9","Type":"ContainerStarted","Data":"eaea9d640caf5c04f6ff84da43ffcc044d77c202f53e45e8ec445b3f04077d65"}
Sep 10 12:35:55.759510 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:35:55.759456    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kmhgj" podStartSLOduration=1.122667861 podStartE2EDuration="3.759434878s" totalImagesPullingTime="2.636767017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:35:55.759155765 +0000 UTC m=+346.879510342" watchObservedRunningTime="2026-09-10 12:35:55.759434878 +0000 UTC m=+346.879789459"
Sep 10 12:36:05.646086 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.646008    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"]
Sep 10 12:36:05.650479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.650463    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.653641 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.653620    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:36:05.654671 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.654653    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:36:05.654671 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.654665    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7hcx\""
Sep 10 12:36:05.661960 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.661940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"]
Sep 10 12:36:05.743636 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.743597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.743636 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.743641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.743832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.743664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgw8g\" (UniqueName: \"kubernetes.io/projected/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-kube-api-access-dgw8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.844687 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.844650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.844858 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.844707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgw8g\" (UniqueName: \"kubernetes.io/projected/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-kube-api-access-dgw8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.844858 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.844803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.845085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.845064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.845085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.845077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.856051 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.856028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgw8g\" (UniqueName: \"kubernetes.io/projected/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-kube-api-access-dgw8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:05.959748 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:05.959717    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:06.230899 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:06.230876    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"]
Sep 10 12:36:06.233318 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:36:06.233289    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe331204_59c5_4e65_a17c_0c5fd0bba5c6.slice/crio-bd1fd47fa85b0e7f7a79ec895d285c7d0aa04590f6587906dc02ff69f8e4d98c WatchSource:0}: Error finding container bd1fd47fa85b0e7f7a79ec895d285c7d0aa04590f6587906dc02ff69f8e4d98c: Status 404 returned error can't find the container with id bd1fd47fa85b0e7f7a79ec895d285c7d0aa04590f6587906dc02ff69f8e4d98c
Sep 10 12:36:06.771618 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:06.771586    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerID="b44655af3e7f71f760c1f89ee98fdfc971928d3db752200389d351eb48318cb6" exitCode=0
Sep 10 12:36:06.771985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:06.771636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf" event={"ID":"fe331204-59c5-4e65-a17c-0c5fd0bba5c6","Type":"ContainerDied","Data":"b44655af3e7f71f760c1f89ee98fdfc971928d3db752200389d351eb48318cb6"}
Sep 10 12:36:06.771985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:06.771673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf" event={"ID":"fe331204-59c5-4e65-a17c-0c5fd0bba5c6","Type":"ContainerStarted","Data":"bd1fd47fa85b0e7f7a79ec895d285c7d0aa04590f6587906dc02ff69f8e4d98c"}
Sep 10 12:36:07.777424 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:07.777346    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerID="13e9d0ca89ca534b92a56f4a399adb5c9be522432e306b560883653470da67f1" exitCode=0
Sep 10 12:36:07.777424 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:07.777395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf" event={"ID":"fe331204-59c5-4e65-a17c-0c5fd0bba5c6","Type":"ContainerDied","Data":"13e9d0ca89ca534b92a56f4a399adb5c9be522432e306b560883653470da67f1"}
Sep 10 12:36:08.783546 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:08.783516    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerID="00cb83a077f053729ab7aed0bba984a43226c047c69bb4b3282528e290c2214a" exitCode=0
Sep 10 12:36:08.783965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:08.783600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf" event={"ID":"fe331204-59c5-4e65-a17c-0c5fd0bba5c6","Type":"ContainerDied","Data":"00cb83a077f053729ab7aed0bba984a43226c047c69bb4b3282528e290c2214a"}
Sep 10 12:36:09.904627 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:09.904599    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:09.977612 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:09.977583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-bundle\") pod \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") "
Sep 10 12:36:09.977776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:09.977633    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-util\") pod \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") "
Sep 10 12:36:09.977776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:09.977656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgw8g\" (UniqueName: \"kubernetes.io/projected/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-kube-api-access-dgw8g\") pod \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\" (UID: \"fe331204-59c5-4e65-a17c-0c5fd0bba5c6\") "
Sep 10 12:36:09.978295 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:09.978255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-bundle" (OuterVolumeSpecName: "bundle") pod "fe331204-59c5-4e65-a17c-0c5fd0bba5c6" (UID: "fe331204-59c5-4e65-a17c-0c5fd0bba5c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:36:09.980229 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:09.980189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-kube-api-access-dgw8g" (OuterVolumeSpecName: "kube-api-access-dgw8g") pod "fe331204-59c5-4e65-a17c-0c5fd0bba5c6" (UID: "fe331204-59c5-4e65-a17c-0c5fd0bba5c6"). InnerVolumeSpecName "kube-api-access-dgw8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:36:09.983138 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:09.983116    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-util" (OuterVolumeSpecName: "util") pod "fe331204-59c5-4e65-a17c-0c5fd0bba5c6" (UID: "fe331204-59c5-4e65-a17c-0c5fd0bba5c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:36:10.079104 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:10.079034    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:36:10.079104 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:10.079054    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:36:10.079104 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:10.079062    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgw8g\" (UniqueName: \"kubernetes.io/projected/fe331204-59c5-4e65-a17c-0c5fd0bba5c6-kube-api-access-dgw8g\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:36:10.793063 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:10.793024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf" event={"ID":"fe331204-59c5-4e65-a17c-0c5fd0bba5c6","Type":"ContainerDied","Data":"bd1fd47fa85b0e7f7a79ec895d285c7d0aa04590f6587906dc02ff69f8e4d98c"}
Sep 10 12:36:10.793336 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:10.793087    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7bsf"
Sep 10 12:36:10.793336 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:10.793108    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd1fd47fa85b0e7f7a79ec895d285c7d0aa04590f6587906dc02ff69f8e4d98c"
Sep 10 12:36:11.110026 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.109947    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"]
Sep 10 12:36:11.110428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.110177    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerName="pull"
Sep 10 12:36:11.110428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.110187    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerName="pull"
Sep 10 12:36:11.110428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.110198    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerName="extract"
Sep 10 12:36:11.110428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.110203    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerName="extract"
Sep 10 12:36:11.110428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.110233    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerName="util"
Sep 10 12:36:11.110428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.110239    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerName="util"
Sep 10 12:36:11.110428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.110279    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe331204-59c5-4e65-a17c-0c5fd0bba5c6" containerName="extract"
Sep 10 12:36:11.113259 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.113243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.123166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.123144    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 12:36:11.150324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.150306    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 12:36:11.151849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.151833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 12:36:11.152061 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.152038    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:36:11.152153 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.152105    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 12:36:11.170305 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.170280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ht8q8\""
Sep 10 12:36:11.171477 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.171459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"]
Sep 10 12:36:11.186407 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.186383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-cert\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.186500 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.186420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-manager-config\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.186500 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.186441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-metrics-cert\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.186500 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.186474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77dcc\" (UniqueName: \"kubernetes.io/projected/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-kube-api-access-77dcc\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.287424 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.287384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-manager-config\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.287424 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.287425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-metrics-cert\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.287627 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.287449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77dcc\" (UniqueName: \"kubernetes.io/projected/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-kube-api-access-77dcc\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.287627 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.287486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-cert\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.288040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.288018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-manager-config\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.290173 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.290148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-metrics-cert\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.290271 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.290144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-cert\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.306339 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.306317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77dcc\" (UniqueName: \"kubernetes.io/projected/b76a1709-912b-45f2-a6b2-9c6b2f356f6d-kube-api-access-77dcc\") pod \"lws-controller-manager-5d95565f4b-v5vbg\" (UID: \"b76a1709-912b-45f2-a6b2-9c6b2f356f6d\") " pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.421879 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.421795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:11.694928 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.694899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"]
Sep 10 12:36:11.697718 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:36:11.697697    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76a1709_912b_45f2_a6b2_9c6b2f356f6d.slice/crio-98904ea65a31a99858043e5c11c56f43639d5af7aee0a1dbe6048016bf0f7447 WatchSource:0}: Error finding container 98904ea65a31a99858043e5c11c56f43639d5af7aee0a1dbe6048016bf0f7447: Status 404 returned error can't find the container with id 98904ea65a31a99858043e5c11c56f43639d5af7aee0a1dbe6048016bf0f7447
Sep 10 12:36:11.798523 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:11.798490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg" event={"ID":"b76a1709-912b-45f2-a6b2-9c6b2f356f6d","Type":"ContainerStarted","Data":"98904ea65a31a99858043e5c11c56f43639d5af7aee0a1dbe6048016bf0f7447"}
Sep 10 12:36:13.809105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:13.809070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg" event={"ID":"b76a1709-912b-45f2-a6b2-9c6b2f356f6d","Type":"ContainerStarted","Data":"099761b56ff11dd0c3e6da8236c6940823aaa1ff7328d08164693c9aca713ebe"}
Sep 10 12:36:13.809489 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:13.809190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:13.827766 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:13.827719    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg" podStartSLOduration=1.296227383 podStartE2EDuration="2.827703355s" totalImagesPullingTime="1.531475972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:36:13.826958474 +0000 UTC m=+364.947313052" watchObservedRunningTime="2026-09-10 12:36:13.827703355 +0000 UTC m=+364.948057932"
Sep 10 12:36:20.848761 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.848727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"]
Sep 10 12:36:20.852067 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.852051    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:20.855592 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.855567    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7hcx\""
Sep 10 12:36:20.863564 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.863549    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:36:20.863662 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.863647    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:36:20.869874 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.869852    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"]
Sep 10 12:36:20.961421 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.961387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:20.961421 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.961421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:20.961610 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:20.961519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrrp\" (UniqueName: \"kubernetes.io/projected/97a83e4f-c9dd-49aa-977d-6ff9860868c3-kube-api-access-tdrrp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.062718 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.062685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.062718 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.062720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.062913 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.062764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrrp\" (UniqueName: \"kubernetes.io/projected/97a83e4f-c9dd-49aa-977d-6ff9860868c3-kube-api-access-tdrrp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.063177 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.063153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.063226 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.063161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.078985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.078959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrrp\" (UniqueName: \"kubernetes.io/projected/97a83e4f-c9dd-49aa-977d-6ff9860868c3-kube-api-access-tdrrp\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.161538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.161454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:21.457262 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.457237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"]
Sep 10 12:36:21.459552 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:36:21.459525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a83e4f_c9dd_49aa_977d_6ff9860868c3.slice/crio-3f2c0896ba3abc0ec00268e0e35b949b37324cf93445b120af651f9bd35f6259 WatchSource:0}: Error finding container 3f2c0896ba3abc0ec00268e0e35b949b37324cf93445b120af651f9bd35f6259: Status 404 returned error can't find the container with id 3f2c0896ba3abc0ec00268e0e35b949b37324cf93445b120af651f9bd35f6259
Sep 10 12:36:21.842538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.842455    2565 generic.go:356] "Generic (PLEG): container finished" podID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerID="8a377c571d52a023c593d9722540f825aefb286c8f4a2db1eaed3690fd93606d" exitCode=0
Sep 10 12:36:21.842697 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.842537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj" event={"ID":"97a83e4f-c9dd-49aa-977d-6ff9860868c3","Type":"ContainerDied","Data":"8a377c571d52a023c593d9722540f825aefb286c8f4a2db1eaed3690fd93606d"}
Sep 10 12:36:21.842697 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:21.842578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj" event={"ID":"97a83e4f-c9dd-49aa-977d-6ff9860868c3","Type":"ContainerStarted","Data":"3f2c0896ba3abc0ec00268e0e35b949b37324cf93445b120af651f9bd35f6259"}
Sep 10 12:36:22.848996 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.848911    2565 generic.go:356] "Generic (PLEG): container finished" podID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerID="223fce458164dddc39a66dcf25afcf357f7efa676123320ec0e303cebb85b9bc" exitCode=0
Sep 10 12:36:22.848996 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.848974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj" event={"ID":"97a83e4f-c9dd-49aa-977d-6ff9860868c3","Type":"ContainerDied","Data":"223fce458164dddc39a66dcf25afcf357f7efa676123320ec0e303cebb85b9bc"}
Sep 10 12:36:22.886867 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.886841    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"]
Sep 10 12:36:22.891595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.891571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:22.895189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.895154    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 12:36:22.895983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.895949    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 12:36:22.897418 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.897265    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 12:36:22.897418 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.897307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 12:36:22.897645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.897624    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j45z8\""
Sep 10 12:36:22.947496 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.947466    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"]
Sep 10 12:36:22.978747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.978717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/433fabc9-5273-4432-9544-a41f855c14d2-tmp\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:22.978747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.978752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/433fabc9-5273-4432-9544-a41f855c14d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:22.978911 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.978791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lh72\" (UniqueName: \"kubernetes.io/projected/433fabc9-5273-4432-9544-a41f855c14d2-kube-api-access-4lh72\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:22.978911 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.978856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/433fabc9-5273-4432-9544-a41f855c14d2-manifests\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:22.979006 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:22.978948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/433fabc9-5273-4432-9544-a41f855c14d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.080383 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.080354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lh72\" (UniqueName: \"kubernetes.io/projected/433fabc9-5273-4432-9544-a41f855c14d2-kube-api-access-4lh72\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.080502 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.080387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/433fabc9-5273-4432-9544-a41f855c14d2-manifests\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.080502 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.080431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/433fabc9-5273-4432-9544-a41f855c14d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.080502 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.080490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/433fabc9-5273-4432-9544-a41f855c14d2-tmp\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.080644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.080517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/433fabc9-5273-4432-9544-a41f855c14d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.080873 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.080851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/433fabc9-5273-4432-9544-a41f855c14d2-manifests\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.082844 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.082823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/433fabc9-5273-4432-9544-a41f855c14d2-tmp\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.082985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.082968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/433fabc9-5273-4432-9544-a41f855c14d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.083042 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.083012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/433fabc9-5273-4432-9544-a41f855c14d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.096348 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.096327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lh72\" (UniqueName: \"kubernetes.io/projected/433fabc9-5273-4432-9544-a41f855c14d2-kube-api-access-4lh72\") pod \"opendatahub-operator-controller-manager-669b9dff44-nlkdz\" (UID: \"433fabc9-5273-4432-9544-a41f855c14d2\") " pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.202201 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.202173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:23.486310 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.486282    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"]
Sep 10 12:36:23.489013 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:36:23.488976    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433fabc9_5273_4432_9544_a41f855c14d2.slice/crio-7aaab9407c7b28e3a318aef7540008f1cb4d16879e1eb7349afeba4ab1da57d2 WatchSource:0}: Error finding container 7aaab9407c7b28e3a318aef7540008f1cb4d16879e1eb7349afeba4ab1da57d2: Status 404 returned error can't find the container with id 7aaab9407c7b28e3a318aef7540008f1cb4d16879e1eb7349afeba4ab1da57d2
Sep 10 12:36:23.854775 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.854683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz" event={"ID":"433fabc9-5273-4432-9544-a41f855c14d2","Type":"ContainerStarted","Data":"7aaab9407c7b28e3a318aef7540008f1cb4d16879e1eb7349afeba4ab1da57d2"}
Sep 10 12:36:23.856913 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.856889    2565 generic.go:356] "Generic (PLEG): container finished" podID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerID="bf947e432b77d6f234e031f5065e5aac24051d6684a0974d4440e98f53cae8fd" exitCode=0
Sep 10 12:36:23.857027 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:23.856945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj" event={"ID":"97a83e4f-c9dd-49aa-977d-6ff9860868c3","Type":"ContainerDied","Data":"bf947e432b77d6f234e031f5065e5aac24051d6684a0974d4440e98f53cae8fd"}
Sep 10 12:36:24.816589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:24.816554    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d95565f4b-v5vbg"
Sep 10 12:36:25.483045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.483018    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:25.602860 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.602825    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-util\") pod \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") "
Sep 10 12:36:25.603050 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.602924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-bundle\") pod \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") "
Sep 10 12:36:25.603050 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.602968    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdrrp\" (UniqueName: \"kubernetes.io/projected/97a83e4f-c9dd-49aa-977d-6ff9860868c3-kube-api-access-tdrrp\") pod \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\" (UID: \"97a83e4f-c9dd-49aa-977d-6ff9860868c3\") "
Sep 10 12:36:25.603748 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.603720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-bundle" (OuterVolumeSpecName: "bundle") pod "97a83e4f-c9dd-49aa-977d-6ff9860868c3" (UID: "97a83e4f-c9dd-49aa-977d-6ff9860868c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:36:25.605434 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.605404    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97a83e4f-c9dd-49aa-977d-6ff9860868c3-kube-api-access-tdrrp" (OuterVolumeSpecName: "kube-api-access-tdrrp") pod "97a83e4f-c9dd-49aa-977d-6ff9860868c3" (UID: "97a83e4f-c9dd-49aa-977d-6ff9860868c3"). InnerVolumeSpecName "kube-api-access-tdrrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:36:25.608225 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.608161    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-util" (OuterVolumeSpecName: "util") pod "97a83e4f-c9dd-49aa-977d-6ff9860868c3" (UID: "97a83e4f-c9dd-49aa-977d-6ff9860868c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:36:25.704474 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.704429    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:36:25.704474 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.704472    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdrrp\" (UniqueName: \"kubernetes.io/projected/97a83e4f-c9dd-49aa-977d-6ff9860868c3-kube-api-access-tdrrp\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:36:25.704702 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.704488    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97a83e4f-c9dd-49aa-977d-6ff9860868c3-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:36:25.869953 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.869865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj" event={"ID":"97a83e4f-c9dd-49aa-977d-6ff9860868c3","Type":"ContainerDied","Data":"3f2c0896ba3abc0ec00268e0e35b949b37324cf93445b120af651f9bd35f6259"}
Sep 10 12:36:25.869953 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.869919    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f2c0896ba3abc0ec00268e0e35b949b37324cf93445b120af651f9bd35f6259"
Sep 10 12:36:25.869953 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:25.869875    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0fvlvj"
Sep 10 12:36:26.875709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:26.875674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz" event={"ID":"433fabc9-5273-4432-9544-a41f855c14d2","Type":"ContainerStarted","Data":"83b810750a9e420d39b49197799b653d8c9e1095d75d713ff46d12545a5e1867"}
Sep 10 12:36:27.881492 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:27.881407    2565 generic.go:356] "Generic (PLEG): container finished" podID="433fabc9-5273-4432-9544-a41f855c14d2" containerID="83b810750a9e420d39b49197799b653d8c9e1095d75d713ff46d12545a5e1867" exitCode=0
Sep 10 12:36:27.881492 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:27.881462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz" event={"ID":"433fabc9-5273-4432-9544-a41f855c14d2","Type":"ContainerDied","Data":"83b810750a9e420d39b49197799b653d8c9e1095d75d713ff46d12545a5e1867"}
Sep 10 12:36:28.887730 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:28.887689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz" event={"ID":"433fabc9-5273-4432-9544-a41f855c14d2","Type":"ContainerStarted","Data":"f8e0e2e0cecfd14a5a1db35a607d380f32e9c6edb2e46e474e3de41720f4a900"}
Sep 10 12:36:28.888190 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:28.887794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:28.917223 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:28.917160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz" podStartSLOduration=2.442656884 podStartE2EDuration="6.9171439s" totalImagesPullingTime="3.469687719s" totalInitContainerRuntime="1.004799297s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:36:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:36:28.915254652 +0000 UTC m=+380.035609254" watchObservedRunningTime="2026-09-10 12:36:28.9171439 +0000 UTC m=+380.037498477"
Sep 10 12:36:39.894576 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:39.894546    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-669b9dff44-nlkdz"
Sep 10 12:36:50.725683 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.725652    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"]
Sep 10 12:36:50.726039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.725962    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerName="pull"
Sep 10 12:36:50.726039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.725976    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerName="pull"
Sep 10 12:36:50.726039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.725987    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerName="util"
Sep 10 12:36:50.726039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.725992    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerName="util"
Sep 10 12:36:50.726039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.725999    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerName="extract"
Sep 10 12:36:50.726039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.726003    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerName="extract"
Sep 10 12:36:50.726270 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.726050    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="97a83e4f-c9dd-49aa-977d-6ff9860868c3" containerName="extract"
Sep 10 12:36:50.734386 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.734362    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.737406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.737375    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 12:36:50.737538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.737385    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 12:36:50.737538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.737414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4ddjs\""
Sep 10 12:36:50.737538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.737430    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 12:36:50.742514 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.742489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"]
Sep 10 12:36:50.781402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzkx\" (UniqueName: \"kubernetes.io/projected/086331ff-7e95-464a-b3ca-1b3b33ca551f-kube-api-access-ptzkx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781760 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781760 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.781760 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.781725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086331ff-7e95-464a-b3ca-1b3b33ca551f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882441 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882441 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzkx\" (UniqueName: \"kubernetes.io/projected/086331ff-7e95-464a-b3ca-1b3b33ca551f-kube-api-access-ptzkx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882711 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882711 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882711 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882711 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086331ff-7e95-464a-b3ca-1b3b33ca551f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882912 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882912 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882912 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.882912 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.882838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.883105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.883044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.883105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.883075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.883206 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.883156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.883470 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.883365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/086331ff-7e95-464a-b3ca-1b3b33ca551f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.885022 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.884997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.885242 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.885205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.891617 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.891589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/086331ff-7e95-464a-b3ca-1b3b33ca551f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:50.891729 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:50.891686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzkx\" (UniqueName: \"kubernetes.io/projected/086331ff-7e95-464a-b3ca-1b3b33ca551f-kube-api-access-ptzkx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2\" (UID: \"086331ff-7e95-464a-b3ca-1b3b33ca551f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:51.045683 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:51.045594    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:51.325632 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:51.325595    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"]
Sep 10 12:36:51.326998 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:36:51.326968    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086331ff_7e95_464a_b3ca_1b3b33ca551f.slice/crio-9948418181be7423934d2a9aade3b1db2eb431f9eb1e53b021f468473b219d8a WatchSource:0}: Error finding container 9948418181be7423934d2a9aade3b1db2eb431f9eb1e53b021f468473b219d8a: Status 404 returned error can't find the container with id 9948418181be7423934d2a9aade3b1db2eb431f9eb1e53b021f468473b219d8a
Sep 10 12:36:51.984392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:51.984357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2" event={"ID":"086331ff-7e95-464a-b3ca-1b3b33ca551f","Type":"ContainerStarted","Data":"9948418181be7423934d2a9aade3b1db2eb431f9eb1e53b021f468473b219d8a"}
Sep 10 12:36:52.753059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.753023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xt8nr"]
Sep 10 12:36:52.756318 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.756292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:52.759017 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.758982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 12:36:52.759153 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.759128    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2rvq7\""
Sep 10 12:36:52.769110 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.769085    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xt8nr"]
Sep 10 12:36:52.798749 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.798715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-cert\") pod \"odh-model-controller-7998c67dc4-xt8nr\" (UID: \"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:52.798933 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.798876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqx4t\" (UniqueName: \"kubernetes.io/projected/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-kube-api-access-gqx4t\") pod \"odh-model-controller-7998c67dc4-xt8nr\" (UID: \"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:52.899315 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.899273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-cert\") pod \"odh-model-controller-7998c67dc4-xt8nr\" (UID: \"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:52.899517 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.899375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqx4t\" (UniqueName: \"kubernetes.io/projected/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-kube-api-access-gqx4t\") pod \"odh-model-controller-7998c67dc4-xt8nr\" (UID: \"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:52.899517 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:36:52.899459    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 12:36:52.899781 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:36:52.899540    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-cert podName:f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e nodeName:}" failed. No retries permitted until 2026-09-10 12:36:53.399519602 +0000 UTC m=+404.519874158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-cert") pod "odh-model-controller-7998c67dc4-xt8nr" (UID: "f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e") : secret "odh-model-controller-webhook-cert" not found
Sep 10 12:36:52.910141 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:52.910097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqx4t\" (UniqueName: \"kubernetes.io/projected/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-kube-api-access-gqx4t\") pod \"odh-model-controller-7998c67dc4-xt8nr\" (UID: \"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:53.404499 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:53.404464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-cert\") pod \"odh-model-controller-7998c67dc4-xt8nr\" (UID: \"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:53.407320 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:53.407294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e-cert\") pod \"odh-model-controller-7998c67dc4-xt8nr\" (UID: \"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:53.670469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:53.670388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:54.206406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:54.205249    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:36:54.206406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:54.205343    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:36:54.206406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:54.205381    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:36:54.406648 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:54.406621    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xt8nr"]
Sep 10 12:36:54.407792 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:36:54.407764    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a0b341_cb57_4b8e_8bba_5ee5c3644f5e.slice/crio-ff72f5c2b8ec79193512cb4d74f59ab4efd6e81a8f67336a3a4378cda9aa887b WatchSource:0}: Error finding container ff72f5c2b8ec79193512cb4d74f59ab4efd6e81a8f67336a3a4378cda9aa887b: Status 404 returned error can't find the container with id ff72f5c2b8ec79193512cb4d74f59ab4efd6e81a8f67336a3a4378cda9aa887b
Sep 10 12:36:54.999107 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:54.999075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr" event={"ID":"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e","Type":"ContainerStarted","Data":"ff72f5c2b8ec79193512cb4d74f59ab4efd6e81a8f67336a3a4378cda9aa887b"}
Sep 10 12:36:55.000462 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:55.000443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2" event={"ID":"086331ff-7e95-464a-b3ca-1b3b33ca551f","Type":"ContainerStarted","Data":"50f772751d9a6a00347e687cc3de0ccdf44053565e5cd67e3e8bebb6313997ae"}
Sep 10 12:36:55.026670 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:55.026620    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2" podStartSLOduration=2.150765821 podStartE2EDuration="5.026604594s" totalImagesPullingTime="2.875838773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:36:55.024459908 +0000 UTC m=+406.144814513" watchObservedRunningTime="2026-09-10 12:36:55.026604594 +0000 UTC m=+406.146959170"
Sep 10 12:36:55.046777 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:55.046748    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:55.051195 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:55.051173    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:56.005663 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:56.005634    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:56.006839 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:56.006815    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2"
Sep 10 12:36:58.017262 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:58.017230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr" event={"ID":"f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e","Type":"ContainerStarted","Data":"b4f24d421ffc4a4c06c798b31e722cf89ccb8e44b8fbb57b0bc33466a08dd0dd"}
Sep 10 12:36:58.017668 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:58.017321    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:36:58.037819 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:36:58.037768    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr" podStartSLOduration=2.910027633 podStartE2EDuration="6.037751645s" totalImagesPullingTime="3.127724012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:36:58.036369414 +0000 UTC m=+409.156724003" watchObservedRunningTime="2026-09-10 12:36:58.037751645 +0000 UTC m=+409.158106222"
Sep 10 12:37:00.151973 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.151941    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"]
Sep 10 12:37:00.155175 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.155155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.158741 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.158719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 12:37:00.158879 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.158751    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 12:37:00.158879 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.158723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 12:37:00.159037 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.159024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mgxvn\""
Sep 10 12:37:00.180634 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.180611    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"]
Sep 10 12:37:00.263313 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.263277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.263486 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.263348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b16f181-f723-454b-90f6-cc34e382dd45-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.263486 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.263394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b16f181-f723-454b-90f6-cc34e382dd45-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.263486 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.263430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b16f181-f723-454b-90f6-cc34e382dd45-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.263486 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.263452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtkn\" (UniqueName: \"kubernetes.io/projected/9b16f181-f723-454b-90f6-cc34e382dd45-kube-api-access-mgtkn\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.263486 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.263481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.263647 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.263551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.364771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.364734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b16f181-f723-454b-90f6-cc34e382dd45-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.364950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.364782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b16f181-f723-454b-90f6-cc34e382dd45-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.364950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.364804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b16f181-f723-454b-90f6-cc34e382dd45-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.364950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.364828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtkn\" (UniqueName: \"kubernetes.io/projected/9b16f181-f723-454b-90f6-cc34e382dd45-kube-api-access-mgtkn\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.364950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.364868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.364950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.364900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.364950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.364944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.365575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.365543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9b16f181-f723-454b-90f6-cc34e382dd45-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.367370 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.367348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.367488 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.367385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.367582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.367566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b16f181-f723-454b-90f6-cc34e382dd45-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.367694 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.367678    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9b16f181-f723-454b-90f6-cc34e382dd45-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.375670 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.375649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b16f181-f723-454b-90f6-cc34e382dd45-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.377766 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.377744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtkn\" (UniqueName: \"kubernetes.io/projected/9b16f181-f723-454b-90f6-cc34e382dd45-kube-api-access-mgtkn\") pod \"istiod-openshift-gateway-5677ccb49b-m5lbb\" (UID: \"9b16f181-f723-454b-90f6-cc34e382dd45\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.464114 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.464082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:00.748938 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:00.748915    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"]
Sep 10 12:37:00.750963 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:37:00.750935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b16f181_f723_454b_90f6_cc34e382dd45.slice/crio-ba7db6e26d1b957871a1886020932b7df0e9b54bbde930f85f9c0132089360ee WatchSource:0}: Error finding container ba7db6e26d1b957871a1886020932b7df0e9b54bbde930f85f9c0132089360ee: Status 404 returned error can't find the container with id ba7db6e26d1b957871a1886020932b7df0e9b54bbde930f85f9c0132089360ee
Sep 10 12:37:01.031330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:01.031251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb" event={"ID":"9b16f181-f723-454b-90f6-cc34e382dd45","Type":"ContainerStarted","Data":"ba7db6e26d1b957871a1886020932b7df0e9b54bbde930f85f9c0132089360ee"}
Sep 10 12:37:03.197336 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:03.197300    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:37:03.197626 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:03.197366    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:37:04.047363 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:04.047332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb" event={"ID":"9b16f181-f723-454b-90f6-cc34e382dd45","Type":"ContainerStarted","Data":"e4e410cff271846a106df0e0ff9dc4b0a072d460b0923b752117c2a68ba81449"}
Sep 10 12:37:04.047545 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:04.047528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:04.049431 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:04.049406    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb"
Sep 10 12:37:04.071005 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:04.070953    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m5lbb" podStartSLOduration=1.626878558 podStartE2EDuration="4.070939133s" totalImagesPullingTime="2.444060575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:37:04.069748924 +0000 UTC m=+415.190103501" watchObservedRunningTime="2026-09-10 12:37:04.070939133 +0000 UTC m=+415.191293711"
Sep 10 12:37:09.024207 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:09.024164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xt8nr"
Sep 10 12:37:29.095519 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:29.095484    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5dfbd4bb-zfd6b"]
Sep 10 12:37:54.117050 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.116997    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b5dfbd4bb-zfd6b" podUID="c5d9d762-ac7c-4958-b27f-7060d3eaf878" containerName="console" containerID="cri-o://31d9339e1174f477c49e1e9ca297c18ec76bbbd4ff5f95fdf82e4a2644d2b6e3" gracePeriod=15
Sep 10 12:37:54.269623 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.269595    2565 generic.go:356] "Generic (PLEG): container finished" podID="c5d9d762-ac7c-4958-b27f-7060d3eaf878" containerID="31d9339e1174f477c49e1e9ca297c18ec76bbbd4ff5f95fdf82e4a2644d2b6e3" exitCode=0
Sep 10 12:37:54.269811 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.269668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5dfbd4bb-zfd6b" event={"ID":"c5d9d762-ac7c-4958-b27f-7060d3eaf878","Type":"ContainerDied","Data":"31d9339e1174f477c49e1e9ca297c18ec76bbbd4ff5f95fdf82e4a2644d2b6e3"}
Sep 10 12:37:54.355581 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.355557    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:37:54.412672 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.412593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-config\") pod \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") "
Sep 10 12:37:54.412672 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.412625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-oauth-config\") pod \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") "
Sep 10 12:37:54.412672 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.412664    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-service-ca\") pod \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") "
Sep 10 12:37:54.412884 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.412691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-oauth-serving-cert\") pod \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") "
Sep 10 12:37:54.412939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.412885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-trusted-ca-bundle\") pod \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") "
Sep 10 12:37:54.412984 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.412967    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8g2p\" (UniqueName: \"kubernetes.io/projected/c5d9d762-ac7c-4958-b27f-7060d3eaf878-kube-api-access-k8g2p\") pod \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") "
Sep 10 12:37:54.413036 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.413013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-serving-cert\") pod \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\" (UID: \"c5d9d762-ac7c-4958-b27f-7060d3eaf878\") "
Sep 10 12:37:54.413185 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.413162    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c5d9d762-ac7c-4958-b27f-7060d3eaf878" (UID: "c5d9d762-ac7c-4958-b27f-7060d3eaf878"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:54.413330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.413164    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-config" (OuterVolumeSpecName: "console-config") pod "c5d9d762-ac7c-4958-b27f-7060d3eaf878" (UID: "c5d9d762-ac7c-4958-b27f-7060d3eaf878"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:54.413330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.413180    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-service-ca" (OuterVolumeSpecName: "service-ca") pod "c5d9d762-ac7c-4958-b27f-7060d3eaf878" (UID: "c5d9d762-ac7c-4958-b27f-7060d3eaf878"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:54.413330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.413262    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c5d9d762-ac7c-4958-b27f-7060d3eaf878" (UID: "c5d9d762-ac7c-4958-b27f-7060d3eaf878"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:54.414890 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.414864    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c5d9d762-ac7c-4958-b27f-7060d3eaf878" (UID: "c5d9d762-ac7c-4958-b27f-7060d3eaf878"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:37:54.415073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.415053    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d9d762-ac7c-4958-b27f-7060d3eaf878-kube-api-access-k8g2p" (OuterVolumeSpecName: "kube-api-access-k8g2p") pod "c5d9d762-ac7c-4958-b27f-7060d3eaf878" (UID: "c5d9d762-ac7c-4958-b27f-7060d3eaf878"). InnerVolumeSpecName "kube-api-access-k8g2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:37:54.415235 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.415202    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c5d9d762-ac7c-4958-b27f-7060d3eaf878" (UID: "c5d9d762-ac7c-4958-b27f-7060d3eaf878"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:37:54.514554 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.514520    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-oauth-serving-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:37:54.514554 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.514548    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-trusted-ca-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:37:54.514554 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.514557    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8g2p\" (UniqueName: \"kubernetes.io/projected/c5d9d762-ac7c-4958-b27f-7060d3eaf878-kube-api-access-k8g2p\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:37:54.514775 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.514566    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-serving-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:37:54.514775 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.514577    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-config\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:37:54.514775 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.514586    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5d9d762-ac7c-4958-b27f-7060d3eaf878-console-oauth-config\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:37:54.514775 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:54.514593    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d9d762-ac7c-4958-b27f-7060d3eaf878-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:37:55.275285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:55.275250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5dfbd4bb-zfd6b" event={"ID":"c5d9d762-ac7c-4958-b27f-7060d3eaf878","Type":"ContainerDied","Data":"68c6c7746c51f3d80bfb6ab416c5954c8e4cf66f3fef9441c7636cfa96a6f2f7"}
Sep 10 12:37:55.275285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:55.275277    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5dfbd4bb-zfd6b"
Sep 10 12:37:55.275772 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:55.275303    2565 scope.go:117] "RemoveContainer" containerID="31d9339e1174f477c49e1e9ca297c18ec76bbbd4ff5f95fdf82e4a2644d2b6e3"
Sep 10 12:37:55.298290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:55.298266    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5dfbd4bb-zfd6b"]
Sep 10 12:37:55.302902 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:55.302879    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b5dfbd4bb-zfd6b"]
Sep 10 12:37:55.394368 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:55.394334    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d9d762-ac7c-4958-b27f-7060d3eaf878" path="/var/lib/kubelet/pods/c5d9d762-ac7c-4958-b27f-7060d3eaf878/volumes"
Sep 10 12:37:59.214786 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.214749    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"]
Sep 10 12:37:59.215199 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.215009    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d9d762-ac7c-4958-b27f-7060d3eaf878" containerName="console"
Sep 10 12:37:59.215199 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.215020    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d9d762-ac7c-4958-b27f-7060d3eaf878" containerName="console"
Sep 10 12:37:59.215199 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.215077    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d9d762-ac7c-4958-b27f-7060d3eaf878" containerName="console"
Sep 10 12:37:59.219442 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.219424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.222553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.222527    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:37:59.222666 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.222528    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:37:59.223726 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.223706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7hcx\""
Sep 10 12:37:59.229295 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.229272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"]
Sep 10 12:37:59.253500 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.253472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.253615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.253534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbgz\" (UniqueName: \"kubernetes.io/projected/33e4add0-e442-4f27-8070-1f80825a5713-kube-api-access-bwbgz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.253615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.253572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.315617 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.315588    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"]
Sep 10 12:37:59.318850 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.318834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.329195 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.329172    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"]
Sep 10 12:37:59.354662 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.354636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbgz\" (UniqueName: \"kubernetes.io/projected/33e4add0-e442-4f27-8070-1f80825a5713-kube-api-access-bwbgz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.354856 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.354674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.354856 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.354700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.354856 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.354745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.354856 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.354765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.354856 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.354805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqz4w\" (UniqueName: \"kubernetes.io/projected/381580a0-9659-45b2-ba5e-a59917745266-kube-api-access-cqz4w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.355077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.355029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.355077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.355057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.363647 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.363625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbgz\" (UniqueName: \"kubernetes.io/projected/33e4add0-e442-4f27-8070-1f80825a5713-kube-api-access-bwbgz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.410429 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.410395    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"]
Sep 10 12:37:59.413724 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.413709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.422689 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.422655    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"]
Sep 10 12:37:59.455201 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.455406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqz4w\" (UniqueName: \"kubernetes.io/projected/381580a0-9659-45b2-ba5e-a59917745266-kube-api-access-cqz4w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.455406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.455406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.455585 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpsg7\" (UniqueName: \"kubernetes.io/projected/6bc57f56-d549-4368-b357-263ec6b16e53-kube-api-access-hpsg7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.455585 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.455672 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.455803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.455773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.465743 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.465687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqz4w\" (UniqueName: \"kubernetes.io/projected/381580a0-9659-45b2-ba5e-a59917745266-kube-api-access-cqz4w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.518385 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.518357    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"]
Sep 10 12:37:59.521815 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.521796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.528582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.528562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:37:59.532961 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.532940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"]
Sep 10 12:37:59.556674 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.556643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.556837 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.556695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpsg7\" (UniqueName: \"kubernetes.io/projected/6bc57f56-d549-4368-b357-263ec6b16e53-kube-api-access-hpsg7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.556837 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.556723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.556837 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.556757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q99h2\" (UniqueName: \"kubernetes.io/projected/2d07cd18-855b-4d92-9000-2c115751ecc3-kube-api-access-q99h2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.556837 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.556778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.556837 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.556799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.557075 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.557041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.557112 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.557092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.566114 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.566082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpsg7\" (UniqueName: \"kubernetes.io/projected/6bc57f56-d549-4368-b357-263ec6b16e53-kube-api-access-hpsg7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.627744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.627709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:37:59.658205 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.658174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.658386 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.658258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q99h2\" (UniqueName: \"kubernetes.io/projected/2d07cd18-855b-4d92-9000-2c115751ecc3-kube-api-access-q99h2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.658386 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.658282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.658535 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.658514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.658597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.658542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.668594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.668570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q99h2\" (UniqueName: \"kubernetes.io/projected/2d07cd18-855b-4d92-9000-2c115751ecc3-kube-api-access-q99h2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.723632 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.723552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:37:59.808398 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.808368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"]
Sep 10 12:37:59.811867 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:37:59.811837    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e4add0_e442_4f27_8070_1f80825a5713.slice/crio-6e920bc0bdbb250c6fc8e0616813d5dbf533e41f159be6498d30d664fb51d7b5 WatchSource:0}: Error finding container 6e920bc0bdbb250c6fc8e0616813d5dbf533e41f159be6498d30d664fb51d7b5: Status 404 returned error can't find the container with id 6e920bc0bdbb250c6fc8e0616813d5dbf533e41f159be6498d30d664fb51d7b5
Sep 10 12:37:59.831582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.831563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:37:59.904671 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.904642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"]
Sep 10 12:37:59.907494 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:37:59.907460    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381580a0_9659_45b2_ba5e_a59917745266.slice/crio-b60bfcba45f4cbae17f70c78edbf78e6364be48a66c29967a8801492266488d2 WatchSource:0}: Error finding container b60bfcba45f4cbae17f70c78edbf78e6364be48a66c29967a8801492266488d2: Status 404 returned error can't find the container with id b60bfcba45f4cbae17f70c78edbf78e6364be48a66c29967a8801492266488d2
Sep 10 12:37:59.995580 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:37:59.995556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"]
Sep 10 12:37:59.997738 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:37:59.997695    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc57f56_d549_4368_b357_263ec6b16e53.slice/crio-c5a2dd1057e64bb86320e1db49ad1887b7d9cf28113ae8a2c69a78a7f219a5d0 WatchSource:0}: Error finding container c5a2dd1057e64bb86320e1db49ad1887b7d9cf28113ae8a2c69a78a7f219a5d0: Status 404 returned error can't find the container with id c5a2dd1057e64bb86320e1db49ad1887b7d9cf28113ae8a2c69a78a7f219a5d0
Sep 10 12:38:00.105624 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.105599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"]
Sep 10 12:38:00.139073 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:38:00.139042    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d07cd18_855b_4d92_9000_2c115751ecc3.slice/crio-a8dc76a22f89ba6dccd04de46759a0c3845e6c716d93cce1cbf00fc9fdc497e1 WatchSource:0}: Error finding container a8dc76a22f89ba6dccd04de46759a0c3845e6c716d93cce1cbf00fc9fdc497e1: Status 404 returned error can't find the container with id a8dc76a22f89ba6dccd04de46759a0c3845e6c716d93cce1cbf00fc9fdc497e1
Sep 10 12:38:00.298266 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.298176    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerID="d555fb6f39dbacede48cd198c2bbd260aa98319f926c0b34f2b6a946f8719ca7" exitCode=0
Sep 10 12:38:00.298266 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.298244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9" event={"ID":"2d07cd18-855b-4d92-9000-2c115751ecc3","Type":"ContainerDied","Data":"d555fb6f39dbacede48cd198c2bbd260aa98319f926c0b34f2b6a946f8719ca7"}
Sep 10 12:38:00.298671 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.298292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9" event={"ID":"2d07cd18-855b-4d92-9000-2c115751ecc3","Type":"ContainerStarted","Data":"a8dc76a22f89ba6dccd04de46759a0c3845e6c716d93cce1cbf00fc9fdc497e1"}
Sep 10 12:38:00.299922 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.299903    2565 generic.go:356] "Generic (PLEG): container finished" podID="381580a0-9659-45b2-ba5e-a59917745266" containerID="a2717696bf1abddca2254283866c213c05e56f5a4efa126185578a0e1ea9130b" exitCode=0
Sep 10 12:38:00.300031 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.299932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst" event={"ID":"381580a0-9659-45b2-ba5e-a59917745266","Type":"ContainerDied","Data":"a2717696bf1abddca2254283866c213c05e56f5a4efa126185578a0e1ea9130b"}
Sep 10 12:38:00.300031 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.299977    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst" event={"ID":"381580a0-9659-45b2-ba5e-a59917745266","Type":"ContainerStarted","Data":"b60bfcba45f4cbae17f70c78edbf78e6364be48a66c29967a8801492266488d2"}
Sep 10 12:38:00.301968 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.301864    2565 generic.go:356] "Generic (PLEG): container finished" podID="33e4add0-e442-4f27-8070-1f80825a5713" containerID="d5f4cd80d2dfdbf60ea399c89081a4de7f9f33e6342752175e47880a33ddc7b1" exitCode=0
Sep 10 12:38:00.301968 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.301896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22" event={"ID":"33e4add0-e442-4f27-8070-1f80825a5713","Type":"ContainerDied","Data":"d5f4cd80d2dfdbf60ea399c89081a4de7f9f33e6342752175e47880a33ddc7b1"}
Sep 10 12:38:00.301968 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.301944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22" event={"ID":"33e4add0-e442-4f27-8070-1f80825a5713","Type":"ContainerStarted","Data":"6e920bc0bdbb250c6fc8e0616813d5dbf533e41f159be6498d30d664fb51d7b5"}
Sep 10 12:38:00.303717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.303690    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bc57f56-d549-4368-b357-263ec6b16e53" containerID="e21bfb7a4dae57f1b8e2b9b15eb07de221ee1974b75732c82c80fd9501ba1285" exitCode=0
Sep 10 12:38:00.303819 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.303718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w" event={"ID":"6bc57f56-d549-4368-b357-263ec6b16e53","Type":"ContainerDied","Data":"e21bfb7a4dae57f1b8e2b9b15eb07de221ee1974b75732c82c80fd9501ba1285"}
Sep 10 12:38:00.303819 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:00.303744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w" event={"ID":"6bc57f56-d549-4368-b357-263ec6b16e53","Type":"ContainerStarted","Data":"c5a2dd1057e64bb86320e1db49ad1887b7d9cf28113ae8a2c69a78a7f219a5d0"}
Sep 10 12:38:01.314374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:01.314351    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bc57f56-d549-4368-b357-263ec6b16e53" containerID="fd3676153943fcb93fd298ae2cc5b9d074c439338c82cd7b2f95573d3a0f6409" exitCode=0
Sep 10 12:38:01.314688 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:01.314405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w" event={"ID":"6bc57f56-d549-4368-b357-263ec6b16e53","Type":"ContainerDied","Data":"fd3676153943fcb93fd298ae2cc5b9d074c439338c82cd7b2f95573d3a0f6409"}
Sep 10 12:38:02.320543 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.320507    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerID="95e122cbc7f165f517b570e4c91f1d6b20c7676291e75b5bd097f78fe60266b0" exitCode=0
Sep 10 12:38:02.320964 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.320590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9" event={"ID":"2d07cd18-855b-4d92-9000-2c115751ecc3","Type":"ContainerDied","Data":"95e122cbc7f165f517b570e4c91f1d6b20c7676291e75b5bd097f78fe60266b0"}
Sep 10 12:38:02.322597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.322579    2565 generic.go:356] "Generic (PLEG): container finished" podID="381580a0-9659-45b2-ba5e-a59917745266" containerID="696beb22325bdf4afc4b335d98d4b8bd02761c2b334d2d36dd73379df89ee9b0" exitCode=0
Sep 10 12:38:02.322696 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.322667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst" event={"ID":"381580a0-9659-45b2-ba5e-a59917745266","Type":"ContainerDied","Data":"696beb22325bdf4afc4b335d98d4b8bd02761c2b334d2d36dd73379df89ee9b0"}
Sep 10 12:38:02.324660 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.324640    2565 generic.go:356] "Generic (PLEG): container finished" podID="33e4add0-e442-4f27-8070-1f80825a5713" containerID="270f85032d5eccbfe069e2ebcc893870825a9f65240f662a54d695d16e561a7f" exitCode=0
Sep 10 12:38:02.324739 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.324720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22" event={"ID":"33e4add0-e442-4f27-8070-1f80825a5713","Type":"ContainerDied","Data":"270f85032d5eccbfe069e2ebcc893870825a9f65240f662a54d695d16e561a7f"}
Sep 10 12:38:02.326973 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.326948    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bc57f56-d549-4368-b357-263ec6b16e53" containerID="8e82bce1d07a14de66225fefcd7cbefab3bbd1b98ed7b9c81cdd2fd804b1c55b" exitCode=0
Sep 10 12:38:02.327066 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:02.327023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w" event={"ID":"6bc57f56-d549-4368-b357-263ec6b16e53","Type":"ContainerDied","Data":"8e82bce1d07a14de66225fefcd7cbefab3bbd1b98ed7b9c81cdd2fd804b1c55b"}
Sep 10 12:38:03.333599 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.333566    2565 generic.go:356] "Generic (PLEG): container finished" podID="381580a0-9659-45b2-ba5e-a59917745266" containerID="82db1f6d1e212fd0f8f170e345421cefd6e3b8f22c5d4c4efe210d30254845d7" exitCode=0
Sep 10 12:38:03.334012 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.333665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst" event={"ID":"381580a0-9659-45b2-ba5e-a59917745266","Type":"ContainerDied","Data":"82db1f6d1e212fd0f8f170e345421cefd6e3b8f22c5d4c4efe210d30254845d7"}
Sep 10 12:38:03.335776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.335751    2565 generic.go:356] "Generic (PLEG): container finished" podID="33e4add0-e442-4f27-8070-1f80825a5713" containerID="0aaa8a72d9512b4060b323f282adbae991bff9ada0a8ce6940ad0f5060393bb7" exitCode=0
Sep 10 12:38:03.335891 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.335832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22" event={"ID":"33e4add0-e442-4f27-8070-1f80825a5713","Type":"ContainerDied","Data":"0aaa8a72d9512b4060b323f282adbae991bff9ada0a8ce6940ad0f5060393bb7"}
Sep 10 12:38:03.337724 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.337705    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerID="7ed0a446296c1154a56b38b989bda742e403283d57821e605d8ee3563f6b39e9" exitCode=0
Sep 10 12:38:03.337820 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.337778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9" event={"ID":"2d07cd18-855b-4d92-9000-2c115751ecc3","Type":"ContainerDied","Data":"7ed0a446296c1154a56b38b989bda742e403283d57821e605d8ee3563f6b39e9"}
Sep 10 12:38:03.465157 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.465136    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:38:03.593598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.593511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-util\") pod \"6bc57f56-d549-4368-b357-263ec6b16e53\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") "
Sep 10 12:38:03.593598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.593555    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpsg7\" (UniqueName: \"kubernetes.io/projected/6bc57f56-d549-4368-b357-263ec6b16e53-kube-api-access-hpsg7\") pod \"6bc57f56-d549-4368-b357-263ec6b16e53\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") "
Sep 10 12:38:03.593598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.593595    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-bundle\") pod \"6bc57f56-d549-4368-b357-263ec6b16e53\" (UID: \"6bc57f56-d549-4368-b357-263ec6b16e53\") "
Sep 10 12:38:03.594182 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.594144    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-bundle" (OuterVolumeSpecName: "bundle") pod "6bc57f56-d549-4368-b357-263ec6b16e53" (UID: "6bc57f56-d549-4368-b357-263ec6b16e53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:03.595839 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.595818    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc57f56-d549-4368-b357-263ec6b16e53-kube-api-access-hpsg7" (OuterVolumeSpecName: "kube-api-access-hpsg7") pod "6bc57f56-d549-4368-b357-263ec6b16e53" (UID: "6bc57f56-d549-4368-b357-263ec6b16e53"). InnerVolumeSpecName "kube-api-access-hpsg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:03.598183 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.598152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-util" (OuterVolumeSpecName: "util") pod "6bc57f56-d549-4368-b357-263ec6b16e53" (UID: "6bc57f56-d549-4368-b357-263ec6b16e53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:03.695031 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.694987    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:03.695031 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.695024    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpsg7\" (UniqueName: \"kubernetes.io/projected/6bc57f56-d549-4368-b357-263ec6b16e53-kube-api-access-hpsg7\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:03.695031 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:03.695034    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bc57f56-d549-4368-b357-263ec6b16e53-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.343734 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.343705    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w"
Sep 10 12:38:04.344156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.343751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8ks9w" event={"ID":"6bc57f56-d549-4368-b357-263ec6b16e53","Type":"ContainerDied","Data":"c5a2dd1057e64bb86320e1db49ad1887b7d9cf28113ae8a2c69a78a7f219a5d0"}
Sep 10 12:38:04.344156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.343799    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5a2dd1057e64bb86320e1db49ad1887b7d9cf28113ae8a2c69a78a7f219a5d0"
Sep 10 12:38:04.486024 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.485990    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:38:04.522792 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.522763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:38:04.526085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.526065    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:38:04.602551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-bundle\") pod \"381580a0-9659-45b2-ba5e-a59917745266\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") "
Sep 10 12:38:04.602551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602499    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-util\") pod \"2d07cd18-855b-4d92-9000-2c115751ecc3\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") "
Sep 10 12:38:04.602551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602524    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-util\") pod \"381580a0-9659-45b2-ba5e-a59917745266\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") "
Sep 10 12:38:04.602805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602559    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-bundle\") pod \"33e4add0-e442-4f27-8070-1f80825a5713\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") "
Sep 10 12:38:04.602805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwbgz\" (UniqueName: \"kubernetes.io/projected/33e4add0-e442-4f27-8070-1f80825a5713-kube-api-access-bwbgz\") pod \"33e4add0-e442-4f27-8070-1f80825a5713\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") "
Sep 10 12:38:04.602805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqz4w\" (UniqueName: \"kubernetes.io/projected/381580a0-9659-45b2-ba5e-a59917745266-kube-api-access-cqz4w\") pod \"381580a0-9659-45b2-ba5e-a59917745266\" (UID: \"381580a0-9659-45b2-ba5e-a59917745266\") "
Sep 10 12:38:04.602805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q99h2\" (UniqueName: \"kubernetes.io/projected/2d07cd18-855b-4d92-9000-2c115751ecc3-kube-api-access-q99h2\") pod \"2d07cd18-855b-4d92-9000-2c115751ecc3\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") "
Sep 10 12:38:04.602805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-util\") pod \"33e4add0-e442-4f27-8070-1f80825a5713\" (UID: \"33e4add0-e442-4f27-8070-1f80825a5713\") "
Sep 10 12:38:04.602805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-bundle\") pod \"2d07cd18-855b-4d92-9000-2c115751ecc3\" (UID: \"2d07cd18-855b-4d92-9000-2c115751ecc3\") "
Sep 10 12:38:04.603098 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.602957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-bundle" (OuterVolumeSpecName: "bundle") pod "381580a0-9659-45b2-ba5e-a59917745266" (UID: "381580a0-9659-45b2-ba5e-a59917745266"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:04.603098 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.603021    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.603189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.603113    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-bundle" (OuterVolumeSpecName: "bundle") pod "33e4add0-e442-4f27-8070-1f80825a5713" (UID: "33e4add0-e442-4f27-8070-1f80825a5713"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:04.603819 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.603778    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-bundle" (OuterVolumeSpecName: "bundle") pod "2d07cd18-855b-4d92-9000-2c115751ecc3" (UID: "2d07cd18-855b-4d92-9000-2c115751ecc3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:04.605621 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.605588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d07cd18-855b-4d92-9000-2c115751ecc3-kube-api-access-q99h2" (OuterVolumeSpecName: "kube-api-access-q99h2") pod "2d07cd18-855b-4d92-9000-2c115751ecc3" (UID: "2d07cd18-855b-4d92-9000-2c115751ecc3"). InnerVolumeSpecName "kube-api-access-q99h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:04.605745 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.605624    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e4add0-e442-4f27-8070-1f80825a5713-kube-api-access-bwbgz" (OuterVolumeSpecName: "kube-api-access-bwbgz") pod "33e4add0-e442-4f27-8070-1f80825a5713" (UID: "33e4add0-e442-4f27-8070-1f80825a5713"). InnerVolumeSpecName "kube-api-access-bwbgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:04.605745 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.605668    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381580a0-9659-45b2-ba5e-a59917745266-kube-api-access-cqz4w" (OuterVolumeSpecName: "kube-api-access-cqz4w") pod "381580a0-9659-45b2-ba5e-a59917745266" (UID: "381580a0-9659-45b2-ba5e-a59917745266"). InnerVolumeSpecName "kube-api-access-cqz4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:04.608465 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.608429    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-util" (OuterVolumeSpecName: "util") pod "2d07cd18-855b-4d92-9000-2c115751ecc3" (UID: "2d07cd18-855b-4d92-9000-2c115751ecc3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:04.609230 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.609192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-util" (OuterVolumeSpecName: "util") pod "381580a0-9659-45b2-ba5e-a59917745266" (UID: "381580a0-9659-45b2-ba5e-a59917745266"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:04.609512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.609495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-util" (OuterVolumeSpecName: "util") pod "33e4add0-e442-4f27-8070-1f80825a5713" (UID: "33e4add0-e442-4f27-8070-1f80825a5713"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:04.703820 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703786    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.703820 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703813    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.703820 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703821    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d07cd18-855b-4d92-9000-2c115751ecc3-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.703820 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703830    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381580a0-9659-45b2-ba5e-a59917745266-util\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.704049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703838    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33e4add0-e442-4f27-8070-1f80825a5713-bundle\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.704049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703845    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwbgz\" (UniqueName: \"kubernetes.io/projected/33e4add0-e442-4f27-8070-1f80825a5713-kube-api-access-bwbgz\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.704049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703854    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqz4w\" (UniqueName: \"kubernetes.io/projected/381580a0-9659-45b2-ba5e-a59917745266-kube-api-access-cqz4w\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:04.704049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:04.703863    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q99h2\" (UniqueName: \"kubernetes.io/projected/2d07cd18-855b-4d92-9000-2c115751ecc3-kube-api-access-q99h2\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:38:05.350039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.350010    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst"
Sep 10 12:38:05.350476 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.350002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6frpst" event={"ID":"381580a0-9659-45b2-ba5e-a59917745266","Type":"ContainerDied","Data":"b60bfcba45f4cbae17f70c78edbf78e6364be48a66c29967a8801492266488d2"}
Sep 10 12:38:05.350476 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.350189    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b60bfcba45f4cbae17f70c78edbf78e6364be48a66c29967a8801492266488d2"
Sep 10 12:38:05.351990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.351972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22"
Sep 10 12:38:05.352101 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.352013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gzg22" event={"ID":"33e4add0-e442-4f27-8070-1f80825a5713","Type":"ContainerDied","Data":"6e920bc0bdbb250c6fc8e0616813d5dbf533e41f159be6498d30d664fb51d7b5"}
Sep 10 12:38:05.352101 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.352056    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e920bc0bdbb250c6fc8e0616813d5dbf533e41f159be6498d30d664fb51d7b5"
Sep 10 12:38:05.354137 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.354113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9" event={"ID":"2d07cd18-855b-4d92-9000-2c115751ecc3","Type":"ContainerDied","Data":"a8dc76a22f89ba6dccd04de46759a0c3845e6c716d93cce1cbf00fc9fdc497e1"}
Sep 10 12:38:05.354137 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.354137    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5vvg9"
Sep 10 12:38:05.354276 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:38:05.354156    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8dc76a22f89ba6dccd04de46759a0c3845e6c716d93cce1cbf00fc9fdc497e1"
Sep 10 12:39:50.599493 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-674dd87cc7-xx8tg"]
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599770    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381580a0-9659-45b2-ba5e-a59917745266" containerName="util"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599785    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="381580a0-9659-45b2-ba5e-a59917745266" containerName="util"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599795    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc57f56-d549-4368-b357-263ec6b16e53" containerName="pull"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599801    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc57f56-d549-4368-b357-263ec6b16e53" containerName="pull"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599806    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e4add0-e442-4f27-8070-1f80825a5713" containerName="pull"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599811    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e4add0-e442-4f27-8070-1f80825a5713" containerName="pull"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599820    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e4add0-e442-4f27-8070-1f80825a5713" containerName="extract"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599826    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e4add0-e442-4f27-8070-1f80825a5713" containerName="extract"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599832    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e4add0-e442-4f27-8070-1f80825a5713" containerName="util"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599836    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e4add0-e442-4f27-8070-1f80825a5713" containerName="util"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599850    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc57f56-d549-4368-b357-263ec6b16e53" containerName="util"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599858    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc57f56-d549-4368-b357-263ec6b16e53" containerName="util"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599867    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc57f56-d549-4368-b357-263ec6b16e53" containerName="extract"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599872    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc57f56-d549-4368-b357-263ec6b16e53" containerName="extract"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599877    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381580a0-9659-45b2-ba5e-a59917745266" containerName="extract"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599882    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="381580a0-9659-45b2-ba5e-a59917745266" containerName="extract"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599890    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerName="util"
Sep 10 12:39:50.599885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599894    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerName="util"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599901    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381580a0-9659-45b2-ba5e-a59917745266" containerName="pull"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599906    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="381580a0-9659-45b2-ba5e-a59917745266" containerName="pull"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599911    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerName="pull"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599915    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerName="pull"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599921    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerName="extract"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599928    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerName="extract"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599981    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d07cd18-855b-4d92-9000-2c115751ecc3" containerName="extract"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599988    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc57f56-d549-4368-b357-263ec6b16e53" containerName="extract"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.599994    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e4add0-e442-4f27-8070-1f80825a5713" containerName="extract"
Sep 10 12:39:50.600479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.600000    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="381580a0-9659-45b2-ba5e-a59917745266" containerName="extract"
Sep 10 12:39:50.602793 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.602775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.605806 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.605786    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 12:39:50.606184 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.606169    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 12:39:50.606959 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.606947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 12:39:50.607025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.606982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9t77v\""
Sep 10 12:39:50.614102 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.614078    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674dd87cc7-xx8tg"]
Sep 10 12:39:50.638724 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.638693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-webhook-cert\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.638857 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.638745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.638857 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.638810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-629q4\" (UniqueName: \"kubernetes.io/projected/977d894e-b2c1-47ba-a2e9-b77060b118ab-kube-api-access-629q4\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.739478 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.739438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629q4\" (UniqueName: \"kubernetes.io/projected/977d894e-b2c1-47ba-a2e9-b77060b118ab-kube-api-access-629q4\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.739684 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.739511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-webhook-cert\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.739684 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.739562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.739684 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:39:50.739664    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 12:39:50.739844 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:39:50.739727    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs podName:977d894e-b2c1-47ba-a2e9-b77060b118ab nodeName:}" failed. No retries permitted until 2026-09-10 12:39:51.239705422 +0000 UTC m=+582.360059976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs") pod "maas-controller-674dd87cc7-xx8tg" (UID: "977d894e-b2c1-47ba-a2e9-b77060b118ab") : secret "maas-controller-metrics-tls" not found
Sep 10 12:39:50.742073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.742053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-webhook-cert\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.750076 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.750048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-629q4\" (UniqueName: \"kubernetes.io/projected/977d894e-b2c1-47ba-a2e9-b77060b118ab-kube-api-access-629q4\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:50.793723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.793693    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-r26xr"]
Sep 10 12:39:50.796983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.796967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.813095 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.813068    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-r26xr"]
Sep 10 12:39:50.840074 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.840045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-metrics-certs\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.840246 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.840088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgrj2\" (UniqueName: \"kubernetes.io/projected/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-kube-api-access-kgrj2\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.840246 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.840147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-webhook-cert\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.940524 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.940489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-webhook-cert\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.940707 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.940539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-metrics-certs\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.940707 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.940573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgrj2\" (UniqueName: \"kubernetes.io/projected/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-kube-api-access-kgrj2\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.943047 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.943023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-metrics-certs\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.943164 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.943144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-webhook-cert\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:50.951033 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:50.951004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgrj2\" (UniqueName: \"kubernetes.io/projected/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-kube-api-access-kgrj2\") pod \"maas-controller-6cf5bb6c98-r26xr\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") " pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:51.107126 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.107084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:51.243249 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.243139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:51.245600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.245581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs\") pod \"maas-controller-674dd87cc7-xx8tg\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") " pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:51.381832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.381806    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-r26xr"]
Sep 10 12:39:51.383710 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:39:51.383684    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f65fcb_3b37_4fd6_9fb6_88ee1c000420.slice/crio-a2c4d3ab1e33c61c0a180e92bda2d7ea4fa724da7dcf48ff5006db0069f20d5d WatchSource:0}: Error finding container a2c4d3ab1e33c61c0a180e92bda2d7ea4fa724da7dcf48ff5006db0069f20d5d: Status 404 returned error can't find the container with id a2c4d3ab1e33c61c0a180e92bda2d7ea4fa724da7dcf48ff5006db0069f20d5d
Sep 10 12:39:51.513298 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.513204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:51.790244 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.790202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674dd87cc7-xx8tg"]
Sep 10 12:39:51.792236 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:39:51.792190    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977d894e_b2c1_47ba_a2e9_b77060b118ab.slice/crio-dfadd830dbd440be12593407dd45983612bab8a697984900fba285b973439592 WatchSource:0}: Error finding container dfadd830dbd440be12593407dd45983612bab8a697984900fba285b973439592: Status 404 returned error can't find the container with id dfadd830dbd440be12593407dd45983612bab8a697984900fba285b973439592
Sep 10 12:39:51.841250 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.841199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674dd87cc7-xx8tg" event={"ID":"977d894e-b2c1-47ba-a2e9-b77060b118ab","Type":"ContainerStarted","Data":"dfadd830dbd440be12593407dd45983612bab8a697984900fba285b973439592"}
Sep 10 12:39:51.842383 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:51.842365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr" event={"ID":"08f65fcb-3b37-4fd6-9fb6-88ee1c000420","Type":"ContainerStarted","Data":"a2c4d3ab1e33c61c0a180e92bda2d7ea4fa724da7dcf48ff5006db0069f20d5d"}
Sep 10 12:39:54.868689 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:54.868650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674dd87cc7-xx8tg" event={"ID":"977d894e-b2c1-47ba-a2e9-b77060b118ab","Type":"ContainerStarted","Data":"737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219"}
Sep 10 12:39:54.869131 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:54.868746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:39:54.870200 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:54.870173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr" event={"ID":"08f65fcb-3b37-4fd6-9fb6-88ee1c000420","Type":"ContainerStarted","Data":"b7a9cc8743f0c6eee8d0a799ea96aee55625041eaac7a7086ab1e759f600e6fd"}
Sep 10 12:39:54.870331 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:54.870245    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:39:54.891598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:54.891502    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-674dd87cc7-xx8tg" podStartSLOduration=2.592195066 podStartE2EDuration="4.891483167s" totalImagesPullingTime="2.299288101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:39:54.890117647 +0000 UTC m=+586.010472236" watchObservedRunningTime="2026-09-10 12:39:54.891483167 +0000 UTC m=+586.011837744"
Sep 10 12:39:54.913126 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:39:54.913074    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr" podStartSLOduration=2.212210571 podStartE2EDuration="4.913057949s" totalImagesPullingTime="2.700847378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:39:54.910785799 +0000 UTC m=+586.031140377" watchObservedRunningTime="2026-09-10 12:39:54.913057949 +0000 UTC m=+586.033412526"
Sep 10 12:40:05.876956 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:05.876928    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:40:05.877487 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:05.876994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 12:40:05.960088 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:05.960035    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674dd87cc7-xx8tg"]
Sep 10 12:40:05.960297 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:05.960274    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-674dd87cc7-xx8tg" podUID="977d894e-b2c1-47ba-a2e9-b77060b118ab" containerName="manager" containerID="cri-o://737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219" gracePeriod=30
Sep 10 12:40:06.195134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.195111    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:40:06.269746 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.269710    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-629q4\" (UniqueName: \"kubernetes.io/projected/977d894e-b2c1-47ba-a2e9-b77060b118ab-kube-api-access-629q4\") pod \"977d894e-b2c1-47ba-a2e9-b77060b118ab\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") "
Sep 10 12:40:06.269908 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.269791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs\") pod \"977d894e-b2c1-47ba-a2e9-b77060b118ab\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") "
Sep 10 12:40:06.269908 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.269809    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-webhook-cert\") pod \"977d894e-b2c1-47ba-a2e9-b77060b118ab\" (UID: \"977d894e-b2c1-47ba-a2e9-b77060b118ab\") "
Sep 10 12:40:06.272103 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.272071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/977d894e-b2c1-47ba-a2e9-b77060b118ab-kube-api-access-629q4" (OuterVolumeSpecName: "kube-api-access-629q4") pod "977d894e-b2c1-47ba-a2e9-b77060b118ab" (UID: "977d894e-b2c1-47ba-a2e9-b77060b118ab"). InnerVolumeSpecName "kube-api-access-629q4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:40:06.272103 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.272086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "977d894e-b2c1-47ba-a2e9-b77060b118ab" (UID: "977d894e-b2c1-47ba-a2e9-b77060b118ab"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:40:06.272280 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.272124    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "977d894e-b2c1-47ba-a2e9-b77060b118ab" (UID: "977d894e-b2c1-47ba-a2e9-b77060b118ab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:40:06.370698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.370665    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-629q4\" (UniqueName: \"kubernetes.io/projected/977d894e-b2c1-47ba-a2e9-b77060b118ab-kube-api-access-629q4\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:40:06.370698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.370695    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:40:06.370698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.370705    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/977d894e-b2c1-47ba-a2e9-b77060b118ab-webhook-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:40:06.936192 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.936157    2565 generic.go:356] "Generic (PLEG): container finished" podID="977d894e-b2c1-47ba-a2e9-b77060b118ab" containerID="737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219" exitCode=0
Sep 10 12:40:06.936582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.936202    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674dd87cc7-xx8tg"
Sep 10 12:40:06.936582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.936236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674dd87cc7-xx8tg" event={"ID":"977d894e-b2c1-47ba-a2e9-b77060b118ab","Type":"ContainerDied","Data":"737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219"}
Sep 10 12:40:06.936582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.936283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674dd87cc7-xx8tg" event={"ID":"977d894e-b2c1-47ba-a2e9-b77060b118ab","Type":"ContainerDied","Data":"dfadd830dbd440be12593407dd45983612bab8a697984900fba285b973439592"}
Sep 10 12:40:06.936582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.936306    2565 scope.go:117] "RemoveContainer" containerID="737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219"
Sep 10 12:40:06.945410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.945391    2565 scope.go:117] "RemoveContainer" containerID="737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219"
Sep 10 12:40:06.945683 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:40:06.945666    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219\": container with ID starting with 737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219 not found: ID does not exist" containerID="737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219"
Sep 10 12:40:06.945730 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.945693    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219"} err="failed to get container status \"737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219\": rpc error: code = NotFound desc = could not find container \"737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219\": container with ID starting with 737f3cf5df548153372f26c9f45fa7ea8f5d0f6875797dffefd0957311240219 not found: ID does not exist"
Sep 10 12:40:06.958397 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.958369    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674dd87cc7-xx8tg"]
Sep 10 12:40:06.962359 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:06.962338    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-674dd87cc7-xx8tg"]
Sep 10 12:40:07.394808 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:07.394766    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977d894e-b2c1-47ba-a2e9-b77060b118ab" path="/var/lib/kubelet/pods/977d894e-b2c1-47ba-a2e9-b77060b118ab/volumes"
Sep 10 12:40:28.767572 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.767531    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"]
Sep 10 12:40:28.772803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.767835    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977d894e-b2c1-47ba-a2e9-b77060b118ab" containerName="manager"
Sep 10 12:40:28.772803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.767846    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="977d894e-b2c1-47ba-a2e9-b77060b118ab" containerName="manager"
Sep 10 12:40:28.772803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.767905    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="977d894e-b2c1-47ba-a2e9-b77060b118ab" containerName="manager"
Sep 10 12:40:28.773115 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.773098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.775971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.775945    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 12:40:28.776508 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.776318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xshvt\""
Sep 10 12:40:28.776999 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.776976    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:40:28.777134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.777023    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 12:40:28.777134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.776982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 12:40:28.785101 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.785079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"]
Sep 10 12:40:28.857198 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.857159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-openshift-service-ca\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.857381 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.857228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7wk5\" (UniqueName: \"kubernetes.io/projected/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-kube-api-access-z7wk5\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.857381 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.857291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-metrics-certs\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.857381 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.857347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-maas-api-tls\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.957981 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.957949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-maas-api-tls\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.957981 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.957990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-openshift-service-ca\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.958203 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.958014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7wk5\" (UniqueName: \"kubernetes.io/projected/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-kube-api-access-z7wk5\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.958203 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.958038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-metrics-certs\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.958618 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.958598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-openshift-service-ca\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.960530 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.960510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-maas-api-tls\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.960591 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.960529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-metrics-certs\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:28.967333 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:28.967312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7wk5\" (UniqueName: \"kubernetes.io/projected/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-kube-api-access-z7wk5\") pod \"maas-api-7797f985f6-5nhpg\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") " pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:29.084278 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:29.084186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:29.399201 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:29.399178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"]
Sep 10 12:40:29.401023 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:40:29.400998    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2c14df_1b3d_4d26_b831_c8e00a6eeae7.slice/crio-42cadddd2b32b4f545907b4ebcc7e21bdb6ec46912904602d780fb09953e1f7e WatchSource:0}: Error finding container 42cadddd2b32b4f545907b4ebcc7e21bdb6ec46912904602d780fb09953e1f7e: Status 404 returned error can't find the container with id 42cadddd2b32b4f545907b4ebcc7e21bdb6ec46912904602d780fb09953e1f7e
Sep 10 12:40:29.402268 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:29.402252    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:40:30.047105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:30.047066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg" event={"ID":"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7","Type":"ContainerStarted","Data":"42cadddd2b32b4f545907b4ebcc7e21bdb6ec46912904602d780fb09953e1f7e"}
Sep 10 12:40:32.060939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:32.060900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg" event={"ID":"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7","Type":"ContainerStarted","Data":"fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540"}
Sep 10 12:40:32.061420 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:32.060963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:40:32.087324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:32.087274    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg" podStartSLOduration=1.645810765 podStartE2EDuration="4.087253503s" totalImagesPullingTime="2.441442738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:40:32.085152288 +0000 UTC m=+623.205506867" watchObservedRunningTime="2026-09-10 12:40:32.087253503 +0000 UTC m=+623.207608080"
Sep 10 12:40:38.070628 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:40:38.070595    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 12:41:05.293040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.293008    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"]
Sep 10 12:41:05.297764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.297737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.300311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.300288    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 12:41:05.300437 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.300343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 12:41:05.301505 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.301487    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j76fb\""
Sep 10 12:41:05.301595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.301523    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 12:41:05.309094 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.309073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"]
Sep 10 12:41:05.375002 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.374970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.375196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.375030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.375196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.375074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.375196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.375103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.375196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.375124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xm42\" (UniqueName: \"kubernetes.io/projected/839dd743-61d1-4251-8e45-fad7039f002b-kube-api-access-2xm42\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.375196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.375158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/839dd743-61d1-4251-8e45-fad7039f002b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476083 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/839dd743-61d1-4251-8e45-fad7039f002b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476302 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476302 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476302 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476302 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476490 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xm42\" (UniqueName: \"kubernetes.io/projected/839dd743-61d1-4251-8e45-fad7039f002b-kube-api-access-2xm42\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476711 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.476711 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.477040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.476738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.478477 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.478457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/839dd743-61d1-4251-8e45-fad7039f002b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.478780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.478764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/839dd743-61d1-4251-8e45-fad7039f002b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.484717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.484688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xm42\" (UniqueName: \"kubernetes.io/projected/839dd743-61d1-4251-8e45-fad7039f002b-kube-api-access-2xm42\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj\" (UID: \"839dd743-61d1-4251-8e45-fad7039f002b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.610503 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.610422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:05.885750 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:05.885723    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"]
Sep 10 12:41:05.887623 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:41:05.887591    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839dd743_61d1_4251_8e45_fad7039f002b.slice/crio-35ccecb2eda268362d72230cef90e3b886f9c1c5d097ef1d9e6c496e39565b8f WatchSource:0}: Error finding container 35ccecb2eda268362d72230cef90e3b886f9c1c5d097ef1d9e6c496e39565b8f: Status 404 returned error can't find the container with id 35ccecb2eda268362d72230cef90e3b886f9c1c5d097ef1d9e6c496e39565b8f
Sep 10 12:41:06.225469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:06.225426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj" event={"ID":"839dd743-61d1-4251-8e45-fad7039f002b","Type":"ContainerStarted","Data":"35ccecb2eda268362d72230cef90e3b886f9c1c5d097ef1d9e6c496e39565b8f"}
Sep 10 12:41:07.232355 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:07.232319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj" event={"ID":"839dd743-61d1-4251-8e45-fad7039f002b","Type":"ContainerStarted","Data":"14c8a4bcc4f2d3105a732b4aeed9e92ce11b632fda7aeaa0abfd1a7b64f46b00"}
Sep 10 12:41:07.252447 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:07.252399    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj" podStartSLOduration=1.122689452 podStartE2EDuration="2.252384142s" totalImagesPullingTime="1.12969469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:41:07.250350724 +0000 UTC m=+658.370705294" watchObservedRunningTime="2026-09-10 12:41:07.252384142 +0000 UTC m=+658.372738718"
Sep 10 12:41:15.611557 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:15.611513    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:15.611557 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:15.611576    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:15.623955 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:15.623933    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:16.285572 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:16.285544    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj"
Sep 10 12:41:26.811334 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.811301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"]
Sep 10 12:41:26.818785 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.818762    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:26.821440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.821418    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 12:41:26.828020 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.827994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"]
Sep 10 12:41:26.961544 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.961513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:26.961748 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.961556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:26.961748 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.961574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:26.961748 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.961697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:26.961898 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.961743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xrq6\" (UniqueName: \"kubernetes.io/projected/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-kube-api-access-2xrq6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:26.961898 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:26.961777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062421 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062421 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xrq6\" (UniqueName: \"kubernetes.io/projected/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-kube-api-access-2xrq6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062421 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062943 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062943 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.062943 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.062886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.064862 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.064845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.064975 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.064957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.074045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.074023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xrq6\" (UniqueName: \"kubernetes.io/projected/2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d-kube-api-access-2xrq6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g5jvj\" (UID: \"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.130110 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.130085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:27.406685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:27.406661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"]
Sep 10 12:41:27.407991 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:41:27.407966    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfc1ad4_4bab_4880_83d3_7d3b0fb6c03d.slice/crio-25f66ec450bcc07a266171d9fba3e949ca7435d1d25a9efe159bdf674d399687 WatchSource:0}: Error finding container 25f66ec450bcc07a266171d9fba3e949ca7435d1d25a9efe159bdf674d399687: Status 404 returned error can't find the container with id 25f66ec450bcc07a266171d9fba3e949ca7435d1d25a9efe159bdf674d399687
Sep 10 12:41:28.333962 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:28.333925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj" event={"ID":"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d","Type":"ContainerStarted","Data":"772759b7d67a08315970050df8515274f73b7321a4c899e8c12771ce0a561363"}
Sep 10 12:41:28.334348 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:28.333980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj" event={"ID":"2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d","Type":"ContainerStarted","Data":"25f66ec450bcc07a266171d9fba3e949ca7435d1d25a9efe159bdf674d399687"}
Sep 10 12:41:28.357117 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:28.357066    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj" podStartSLOduration=2.169668327 podStartE2EDuration="2.357051497s" totalImagesPullingTime="187.38317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:41:28.355672797 +0000 UTC m=+679.476027376" watchObservedRunningTime="2026-09-10 12:41:28.357051497 +0000 UTC m=+679.477406109"
Sep 10 12:41:37.130253 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:37.130197    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:37.130739 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:37.130439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:37.142969 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:37.142947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:41:37.387582 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:41:37.387503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g5jvj"
Sep 10 12:43:53.706004 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.705975    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"]
Sep 10 12:43:53.709268 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.709252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.712551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.712529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f85889-openshift-default-dockercfg-sg45r\""
Sep 10 12:43:53.755185 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.755155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"]
Sep 10 12:43:53.792423 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-socket\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792423 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c681bc0-4a39-40f1-aa97-93914bb411dd-istiod-ca-cert\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792613 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-data\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792613 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-certs\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792613 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-podinfo\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p95tk\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-kube-api-access-p95tk\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-credential-socket\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-token\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.792800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.792729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-envoy\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.893744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.893710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-data\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.893744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.893744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-certs\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.893984 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.893790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-podinfo\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.893984 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.893808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p95tk\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-kube-api-access-p95tk\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.893984 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.893828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-credential-socket\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.893984 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.893846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-token\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894173 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-envoy\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894173 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-socket\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894173 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c681bc0-4a39-40f1-aa97-93914bb411dd-istiod-ca-cert\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894367 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-certs\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894367 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-data\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894367 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-credential-socket\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894530 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-socket\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.894731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.894713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c681bc0-4a39-40f1-aa97-93914bb411dd-istiod-ca-cert\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.896809 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.896789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-envoy\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.897015 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.896997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-podinfo\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:53.936389 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:53.936364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p95tk\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-kube-api-access-p95tk\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:54.027072 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.027004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-token\") pod \"e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") " pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:54.061487 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.061459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"]
Sep 10 12:43:54.065877 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.065861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.071349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.071327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-1312ea-openshift-default-dockercfg-678d2\""
Sep 10 12:43:54.087561 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.087539    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"]
Sep 10 12:43:54.196934 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.196897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-certs\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.196953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-data\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.196988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-podinfo\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.197017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-credential-socket\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.197045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5bf5\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-kube-api-access-w5bf5\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.197064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-socket\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.197080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43df5fb-b513-46ff-bd81-71f175b43cd4-istiod-ca-cert\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197113 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.197097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-envoy\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.197381 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.197116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-token\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-certs\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-data\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298547 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-podinfo\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298547 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-credential-socket\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298547 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5bf5\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-kube-api-access-w5bf5\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298676 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-socket\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298676 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43df5fb-b513-46ff-bd81-71f175b43cd4-istiod-ca-cert\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298676 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-envoy\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-token\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-certs\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-credential-socket\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298988 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-data\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.298988 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.298931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-socket\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.299269 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.299246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43df5fb-b513-46ff-bd81-71f175b43cd4-istiod-ca-cert\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.301016 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.300996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-podinfo\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.301102 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.301026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-envoy\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.317556 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.317509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5bf5\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-kube-api-access-w5bf5\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.317756 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.317576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-token\") pod \"e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") " pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.319306 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.319284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:54.377589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.377557    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:54.617301 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.617272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"]
Sep 10 12:43:54.617815 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:43:54.617789    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c681bc0_4a39_40f1_aa97_93914bb411dd.slice/crio-483fa55a536f2bc1079343b3a702ff7d7fcba0a288368c87abc3ec3ba99eaefe WatchSource:0}: Error finding container 483fa55a536f2bc1079343b3a702ff7d7fcba0a288368c87abc3ec3ba99eaefe: Status 404 returned error can't find the container with id 483fa55a536f2bc1079343b3a702ff7d7fcba0a288368c87abc3ec3ba99eaefe
Sep 10 12:43:54.620142 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.620111    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:43:54.620237 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.620176    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:43:54.620237 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.620204    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:43:54.685644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.685618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"]
Sep 10 12:43:54.687651 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:43:54.687629    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43df5fb_b513_46ff_bd81_71f175b43cd4.slice/crio-2d6957a24d69ec83760e167b121b4f7352cb062091c94ac45991c057c9330e31 WatchSource:0}: Error finding container 2d6957a24d69ec83760e167b121b4f7352cb062091c94ac45991c057c9330e31: Status 404 returned error can't find the container with id 2d6957a24d69ec83760e167b121b4f7352cb062091c94ac45991c057c9330e31
Sep 10 12:43:54.690307 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.690270    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:43:54.690403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.690353    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:43:54.690447 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:54.690397    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:43:55.025832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.025799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" event={"ID":"e43df5fb-b513-46ff-bd81-71f175b43cd4","Type":"ContainerStarted","Data":"5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948"}
Sep 10 12:43:55.026326 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.025856    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" event={"ID":"e43df5fb-b513-46ff-bd81-71f175b43cd4","Type":"ContainerStarted","Data":"2d6957a24d69ec83760e167b121b4f7352cb062091c94ac45991c057c9330e31"}
Sep 10 12:43:55.027727 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.027702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" event={"ID":"4c681bc0-4a39-40f1-aa97-93914bb411dd","Type":"ContainerStarted","Data":"dbc63e1d96f16f26a4124757c3fee0eb204ea5686049470a545b12229b8e92a8"}
Sep 10 12:43:55.027873 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.027742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" event={"ID":"4c681bc0-4a39-40f1-aa97-93914bb411dd","Type":"ContainerStarted","Data":"483fa55a536f2bc1079343b3a702ff7d7fcba0a288368c87abc3ec3ba99eaefe"}
Sep 10 12:43:55.077232 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.077157    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podStartSLOduration=1.077136418 podStartE2EDuration="1.077136418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:55.072180251 +0000 UTC m=+826.192534830" watchObservedRunningTime="2026-09-10 12:43:55.077136418 +0000 UTC m=+826.197490997"
Sep 10 12:43:55.118353 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.118293    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podStartSLOduration=2.118271786 podStartE2EDuration="2.118271786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:43:55.116377515 +0000 UTC m=+826.236732093" watchObservedRunningTime="2026-09-10 12:43:55.118271786 +0000 UTC m=+826.238626363"
Sep 10 12:43:55.320179 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.320099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:55.324657 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.324631    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:55.378457 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.378426    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:55.379758 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.379733    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 10 12:43:55.379874 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:55.379792    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 10 12:43:56.032721 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:56.032688    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:56.033680 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:56.033662    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:43:56.382595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:56.382513    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:57.037870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:57.037835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:57.038744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:57.038725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:43:58.689357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.689325    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"]
Sep 10 12:43:58.692667 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.692648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.696824 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.696801    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-f85889-serving-cert\""
Sep 10 12:43:58.720347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.720314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"]
Sep 10 12:43:58.843103 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.843068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mg94\" (UniqueName: \"kubernetes.io/projected/7560938b-7407-4940-b12b-072edf8670db-kube-api-access-9mg94\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.843294 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.843118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7560938b-7407-4940-b12b-072edf8670db-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.843294 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.843255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-metrics-certs\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.843390 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.843306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.944456 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.944369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mg94\" (UniqueName: \"kubernetes.io/projected/7560938b-7407-4940-b12b-072edf8670db-kube-api-access-9mg94\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.944456 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.944428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7560938b-7407-4940-b12b-072edf8670db-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.944642 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.944478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-metrics-certs\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.944642 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.944540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.944642 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:43:58.944637    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-serving-cert: secret "maas-api-e2e-inf-a-f85889-serving-cert" not found
Sep 10 12:43:58.944741 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:43:58.944702    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls podName:7560938b-7407-4940-b12b-072edf8670db nodeName:}" failed. No retries permitted until 2026-09-10 12:43:59.444682308 +0000 UTC m=+830.565036868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls") pod "maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl" (UID: "7560938b-7407-4940-b12b-072edf8670db") : secret "maas-api-e2e-inf-a-f85889-serving-cert" not found
Sep 10 12:43:58.945093 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.945071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7560938b-7407-4940-b12b-072edf8670db-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.947086 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.947062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-metrics-certs\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:58.963922 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:58.963892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mg94\" (UniqueName: \"kubernetes.io/projected/7560938b-7407-4940-b12b-072edf8670db-kube-api-access-9mg94\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:59.449157 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:59.449127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:59.451601 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:59.451581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls\") pod \"maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:59.603554 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:59.603521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:43:59.930817 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:43:59.930787    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"]
Sep 10 12:43:59.931292 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:43:59.931267    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7560938b_7407_4940_b12b_072edf8670db.slice/crio-f99a47f715b6d34d920219e9b390ea974ca6e397611ba3b09821a1a3d9282a3f WatchSource:0}: Error finding container f99a47f715b6d34d920219e9b390ea974ca6e397611ba3b09821a1a3d9282a3f: Status 404 returned error can't find the container with id f99a47f715b6d34d920219e9b390ea974ca6e397611ba3b09821a1a3d9282a3f
Sep 10 12:44:00.060921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.060882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl" event={"ID":"7560938b-7407-4940-b12b-072edf8670db","Type":"ContainerStarted","Data":"f99a47f715b6d34d920219e9b390ea974ca6e397611ba3b09821a1a3d9282a3f"}
Sep 10 12:44:00.676044 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.676014    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"]
Sep 10 12:44:00.680709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.680688    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.683885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.683868    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-1312ea-serving-cert\""
Sep 10 12:44:00.701488 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.701461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"]
Sep 10 12:44:00.759996 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.759955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3acc31-ae29-41ef-9eb7-93b94646b28a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.760193 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.760008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.760193 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.760068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sslpp\" (UniqueName: \"kubernetes.io/projected/3a3acc31-ae29-41ef-9eb7-93b94646b28a-kube-api-access-sslpp\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.760193 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.760141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-metrics-certs\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.860724 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.860683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3acc31-ae29-41ef-9eb7-93b94646b28a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.860925 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.860758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.860925 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.860797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sslpp\" (UniqueName: \"kubernetes.io/projected/3a3acc31-ae29-41ef-9eb7-93b94646b28a-kube-api-access-sslpp\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.860925 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.860850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-metrics-certs\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.861934 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.861894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3acc31-ae29-41ef-9eb7-93b94646b28a-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.863705 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.863680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-maas-api-tls\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.863820 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.863688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-metrics-certs\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.874950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.874920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sslpp\" (UniqueName: \"kubernetes.io/projected/3a3acc31-ae29-41ef-9eb7-93b94646b28a-kube-api-access-sslpp\") pod \"maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:00.991093 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:00.991059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:01.300988 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:01.300961    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"]
Sep 10 12:44:01.303433 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:44:01.303408    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3acc31_ae29_41ef_9eb7_93b94646b28a.slice/crio-e50734ce8bf72a619dc4f2368607a43a3a2b2bbc1a4f98ae4c44a433f068a972 WatchSource:0}: Error finding container e50734ce8bf72a619dc4f2368607a43a3a2b2bbc1a4f98ae4c44a433f068a972: Status 404 returned error can't find the container with id e50734ce8bf72a619dc4f2368607a43a3a2b2bbc1a4f98ae4c44a433f068a972
Sep 10 12:44:02.074130 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.074095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl" event={"ID":"7560938b-7407-4940-b12b-072edf8670db","Type":"ContainerStarted","Data":"575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f"}
Sep 10 12:44:02.074620 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.074244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:44:02.075931 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.075908    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7" event={"ID":"3a3acc31-ae29-41ef-9eb7-93b94646b28a","Type":"ContainerStarted","Data":"4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20"}
Sep 10 12:44:02.076060 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.075952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7" event={"ID":"3a3acc31-ae29-41ef-9eb7-93b94646b28a","Type":"ContainerStarted","Data":"e50734ce8bf72a619dc4f2368607a43a3a2b2bbc1a4f98ae4c44a433f068a972"}
Sep 10 12:44:02.076060 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.075980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:02.112492 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.112433    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl" podStartSLOduration=2.759598458 podStartE2EDuration="4.112416225s" totalImagesPullingTime="1.352817767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:02.109712499 +0000 UTC m=+833.230067076" watchObservedRunningTime="2026-09-10 12:44:02.112416225 +0000 UTC m=+833.232770801"
Sep 10 12:44:02.152422 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.152361    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7" podStartSLOduration=1.802602806 podStartE2EDuration="2.152344704s" totalImagesPullingTime="349.741898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:44:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:02.15039488 +0000 UTC m=+833.270749482" watchObservedRunningTime="2026-09-10 12:44:02.152344704 +0000 UTC m=+833.272699319"
Sep 10 12:44:02.907401 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.907367    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"]
Sep 10 12:44:02.911197 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.911177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:02.919049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.919016    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-30919a-serving-cert\""
Sep 10 12:44:02.944991 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:02.944958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"]
Sep 10 12:44:03.082966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.082934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.083343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.083083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-metrics-certs\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.083343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.083295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01a308-459e-46ec-871f-a1c86978183e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.083343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.083329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwfbh\" (UniqueName: \"kubernetes.io/projected/2b01a308-459e-46ec-871f-a1c86978183e-kube-api-access-vwfbh\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.184141 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.184064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01a308-459e-46ec-871f-a1c86978183e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.184141 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.184096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwfbh\" (UniqueName: \"kubernetes.io/projected/2b01a308-459e-46ec-871f-a1c86978183e-kube-api-access-vwfbh\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.184374 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.184203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.184374 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:03.184352    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-serving-cert: secret "maas-api-e2e-worker-w0-30919a-serving-cert" not found
Sep 10 12:44:03.184489 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:03.184424    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls podName:2b01a308-459e-46ec-871f-a1c86978183e nodeName:}" failed. No retries permitted until 2026-09-10 12:44:03.68440283 +0000 UTC m=+834.804757387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls") pod "maas-api-e2e-worker-w0-30919a-5456488684-scxlg" (UID: "2b01a308-459e-46ec-871f-a1c86978183e") : secret "maas-api-e2e-worker-w0-30919a-serving-cert" not found
Sep 10 12:44:03.184489 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.184477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-metrics-certs\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.185448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.185415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01a308-459e-46ec-871f-a1c86978183e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.192830 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.192663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-metrics-certs\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.203048 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.203022    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwfbh\" (UniqueName: \"kubernetes.io/projected/2b01a308-459e-46ec-871f-a1c86978183e-kube-api-access-vwfbh\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.692294 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.692257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.695027 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.694998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-30919a-5456488684-scxlg\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:03.821835 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:03.821798    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:04.172871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:04.172841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"]
Sep 10 12:44:04.174396 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:44:04.174363    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b01a308_459e_46ec_871f_a1c86978183e.slice/crio-e4f931feb6e3ede49c23428983236bea606937a1a83f74d0748684e9a9a0de82 WatchSource:0}: Error finding container e4f931feb6e3ede49c23428983236bea606937a1a83f74d0748684e9a9a0de82: Status 404 returned error can't find the container with id e4f931feb6e3ede49c23428983236bea606937a1a83f74d0748684e9a9a0de82
Sep 10 12:44:05.093167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:05.093130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg" event={"ID":"2b01a308-459e-46ec-871f-a1c86978183e","Type":"ContainerStarted","Data":"e4f931feb6e3ede49c23428983236bea606937a1a83f74d0748684e9a9a0de82"}
Sep 10 12:44:06.099487 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:06.099454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg" event={"ID":"2b01a308-459e-46ec-871f-a1c86978183e","Type":"ContainerStarted","Data":"37169c2e21764df2959cd703dc218aacc7b5a1672b36500fbaa21ad4de123dc6"}
Sep 10 12:44:06.099912 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:06.099537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:06.246093 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:06.246037    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg" podStartSLOduration=3.226494062 podStartE2EDuration="4.246019551s" totalImagesPullingTime="1.019525489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:06.242026561 +0000 UTC m=+837.362381138" watchObservedRunningTime="2026-09-10 12:44:06.246019551 +0000 UTC m=+837.366374128"
Sep 10 12:44:08.097194 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:08.097160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:44:08.100516 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:08.100487    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:44:12.117404 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:12.117364    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:44:14.198670 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.198629    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"]
Sep 10 12:44:14.203574 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.203550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.207224 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.207180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-5abff0-serving-cert\""
Sep 10 12:44:14.237304 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.237271    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"]
Sep 10 12:44:14.291670 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.291635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c525f02-5ae0-42cd-9876-018d670d34e0-openshift-service-ca\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.291870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.291710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-metrics-certs\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.291870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.291807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-maas-api-tls\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.291870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.291839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59wwn\" (UniqueName: \"kubernetes.io/projected/1c525f02-5ae0-42cd-9876-018d670d34e0-kube-api-access-59wwn\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.392540 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.392499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-maas-api-tls\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.392717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.392550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59wwn\" (UniqueName: \"kubernetes.io/projected/1c525f02-5ae0-42cd-9876-018d670d34e0-kube-api-access-59wwn\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.392717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.392620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c525f02-5ae0-42cd-9876-018d670d34e0-openshift-service-ca\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.392717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.392700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-metrics-certs\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.393932 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.393899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c525f02-5ae0-42cd-9876-018d670d34e0-openshift-service-ca\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.395335 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.395300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-metrics-certs\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.395452 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.395344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-maas-api-tls\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.420475 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.420440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59wwn\" (UniqueName: \"kubernetes.io/projected/1c525f02-5ae0-42cd-9876-018d670d34e0-kube-api-access-59wwn\") pod \"maas-api-e2e-autores-5abff0-64688d988-gqmnl\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.514796 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.514716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:14.823460 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:14.823269    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"]
Sep 10 12:44:14.826030 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:44:14.825989    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c525f02_5ae0_42cd_9876_018d670d34e0.slice/crio-eecb4c82c291e7a75db6422d9b65c26bedc94bfeeedc350e21948a24c04a59f8 WatchSource:0}: Error finding container eecb4c82c291e7a75db6422d9b65c26bedc94bfeeedc350e21948a24c04a59f8: Status 404 returned error can't find the container with id eecb4c82c291e7a75db6422d9b65c26bedc94bfeeedc350e21948a24c04a59f8
Sep 10 12:44:15.163430 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:15.163342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl" event={"ID":"1c525f02-5ae0-42cd-9876-018d670d34e0","Type":"ContainerStarted","Data":"eecb4c82c291e7a75db6422d9b65c26bedc94bfeeedc350e21948a24c04a59f8"}
Sep 10 12:44:16.170468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:16.170432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl" event={"ID":"1c525f02-5ae0-42cd-9876-018d670d34e0","Type":"ContainerStarted","Data":"771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f"}
Sep 10 12:44:16.170853 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:16.170502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:16.260111 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:16.249110    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl" podStartSLOduration=1.779822198 podStartE2EDuration="2.249088688s" totalImagesPullingTime="469.26649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:16.244759183 +0000 UTC m=+847.365113761" watchObservedRunningTime="2026-09-10 12:44:16.249088688 +0000 UTC m=+847.369443268"
Sep 10 12:44:17.176953 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.176923    2565 generic.go:356] "Generic (PLEG): container finished" podID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerID="5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948" exitCode=0
Sep 10 12:44:17.177385 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.176999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" event={"ID":"e43df5fb-b513-46ff-bd81-71f175b43cd4","Type":"ContainerDied","Data":"5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948"}
Sep 10 12:44:17.177502 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.177485    2565 scope.go:117] "RemoveContainer" containerID="5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948"
Sep 10 12:44:17.178733 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.178700    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:44:17.178840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.178787    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:44:17.178840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.178809    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerID="dbc63e1d96f16f26a4124757c3fee0eb204ea5686049470a545b12229b8e92a8" exitCode=0
Sep 10 12:44:17.178840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.178835    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:44:17.178963 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.178885    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" event={"ID":"4c681bc0-4a39-40f1-aa97-93914bb411dd","Type":"ContainerDied","Data":"dbc63e1d96f16f26a4124757c3fee0eb204ea5686049470a545b12229b8e92a8"}
Sep 10 12:44:17.179354 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.179341    2565 scope.go:117] "RemoveContainer" containerID="dbc63e1d96f16f26a4124757c3fee0eb204ea5686049470a545b12229b8e92a8"
Sep 10 12:44:17.180321 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.180297    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:44:17.180390 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.180354    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:44:17.180426 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:17.180385    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:44:18.187231 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.187184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" event={"ID":"4c681bc0-4a39-40f1-aa97-93914bb411dd","Type":"ContainerStarted","Data":"d4764f2124821552550cd4c80606cfef0d5e200de6630f9fb7a095b63a3cdea5"}
Sep 10 12:44:18.189194 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.189170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" event={"ID":"e43df5fb-b513-46ff-bd81-71f175b43cd4","Type":"ContainerStarted","Data":"e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a"}
Sep 10 12:44:18.320418 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.320384    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:44:18.320685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.320664    2565 patch_prober.go:28] interesting pod/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:44:18.320778 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.320714    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 10 12:44:18.378368 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.378335    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:44:18.378686 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.378661    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 10 12:44:18.378786 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:18.378715    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 10 12:44:19.320792 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:19.320749    2565 patch_prober.go:28] interesting pod/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:44:19.321441 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:19.321409    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 10 12:44:19.378319 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:19.378284    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 10 12:44:19.378493 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:19.378338    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 10 12:44:20.111495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.111458    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"]
Sep 10 12:44:20.121327 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.117456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.125876 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.125851    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c8b03106-serving-cert\""
Sep 10 12:44:20.142456 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.142434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-metrics-certs\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.142575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.142471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c18127a0-5610-43bd-9b8b-f0049685d796-openshift-service-ca\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.142575 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.142536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.142690 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.142609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkfgh\" (UniqueName: \"kubernetes.io/projected/c18127a0-5610-43bd-9b8b-f0049685d796-kube-api-access-vkfgh\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.166019 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.165995    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"]
Sep 10 12:44:20.243707 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.243670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfgh\" (UniqueName: \"kubernetes.io/projected/c18127a0-5610-43bd-9b8b-f0049685d796-kube-api-access-vkfgh\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.243877 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.243728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-metrics-certs\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.243877 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.243768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c18127a0-5610-43bd-9b8b-f0049685d796-openshift-service-ca\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.243877 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.243798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.243984 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:20.243914    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-serving-cert: secret "maas-api-e2e-ait-c8b03106-serving-cert" not found
Sep 10 12:44:20.243984 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:20.243971    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls podName:c18127a0-5610-43bd-9b8b-f0049685d796 nodeName:}" failed. No retries permitted until 2026-09-10 12:44:20.743954028 +0000 UTC m=+851.864308584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls") pod "maas-api-e2e-ait-c8b03106-854f785656-kgp6m" (UID: "c18127a0-5610-43bd-9b8b-f0049685d796") : secret "maas-api-e2e-ait-c8b03106-serving-cert" not found
Sep 10 12:44:20.244447 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.244421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c18127a0-5610-43bd-9b8b-f0049685d796-openshift-service-ca\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.246779 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.246753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-metrics-certs\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.274419 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.274364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkfgh\" (UniqueName: \"kubernetes.io/projected/c18127a0-5610-43bd-9b8b-f0049685d796-kube-api-access-vkfgh\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.320917 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.320450    2565 patch_prober.go:28] interesting pod/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:44:20.320917 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.320521    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 10 12:44:20.378330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.378135    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 10 12:44:20.378330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.378182    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 10 12:44:20.748573 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:20.748537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:20.748740 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:20.748676    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-serving-cert: secret "maas-api-e2e-ait-c8b03106-serving-cert" not found
Sep 10 12:44:20.748740 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:20.748733    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls podName:c18127a0-5610-43bd-9b8b-f0049685d796 nodeName:}" failed. No retries permitted until 2026-09-10 12:44:21.748717239 +0000 UTC m=+852.869071794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls") pod "maas-api-e2e-ait-c8b03106-854f785656-kgp6m" (UID: "c18127a0-5610-43bd-9b8b-f0049685d796") : secret "maas-api-e2e-ait-c8b03106-serving-cert" not found
Sep 10 12:44:21.320161 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:21.320111    2565 patch_prober.go:28] interesting pod/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:44:21.320506 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:21.320452    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 10 12:44:21.378607 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:21.378575    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 10 12:44:21.379012 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:21.378629    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 10 12:44:21.758566 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:21.758535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:21.764852 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:21.763812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls\") pod \"maas-api-e2e-ait-c8b03106-854f785656-kgp6m\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:21.945477 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:21.945445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:22.229237 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:22.228375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:44:22.336654 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:22.325478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"]
Sep 10 12:44:22.336654 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:22.326009    2565 patch_prober.go:28] interesting pod/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:44:22.336654 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:22.326067    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 10 12:44:22.336654 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:44:22.336529    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18127a0_5610_43bd_9b8b_f0049685d796.slice/crio-4754ead91d6aa4d40dc4c168a593f9a80b39016f86520b91423e30504b5300d5 WatchSource:0}: Error finding container 4754ead91d6aa4d40dc4c168a593f9a80b39016f86520b91423e30504b5300d5: Status 404 returned error can't find the container with id 4754ead91d6aa4d40dc4c168a593f9a80b39016f86520b91423e30504b5300d5
Sep 10 12:44:22.378784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:22.378754    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 10 12:44:22.379127 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:22.378802    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 10 12:44:23.240902 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:23.240868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m" event={"ID":"c18127a0-5610-43bd-9b8b-f0049685d796","Type":"ContainerStarted","Data":"4754ead91d6aa4d40dc4c168a593f9a80b39016f86520b91423e30504b5300d5"}
Sep 10 12:44:23.320059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:23.320019    2565 patch_prober.go:28] interesting pod/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:44:23.320396 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:23.320368    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 10 12:44:23.378384 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:23.378351    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 10 12:44:23.378548 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:23.378406    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 10 12:44:24.249232 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.249171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m" event={"ID":"c18127a0-5610-43bd-9b8b-f0049685d796","Type":"ContainerStarted","Data":"71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903"}
Sep 10 12:44:24.249714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.249411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:24.320290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.320246    2565 patch_prober.go:28] interesting pod/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:44:24.320483 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.320312    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 10 12:44:24.381518 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.381482    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:44:24.381901 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.381878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:44:24.382637 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.382618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:44:24.467130 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:24.467078    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m" podStartSLOduration=3.254168019 podStartE2EDuration="4.467063268s" totalImagesPullingTime="1.212895249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:24.292644681 +0000 UTC m=+855.412999259" watchObservedRunningTime="2026-09-10 12:44:24.467063268 +0000 UTC m=+855.587417844"
Sep 10 12:44:25.324122 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:25.324096    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:44:25.324542 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:25.324456    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:44:25.325164 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:25.325140    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:44:30.259831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:30.259802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:39.990785 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:39.990747    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"]
Sep 10 12:44:39.993194 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:39.993179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:39.996223 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:39.996189    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-714b74-serving-cert\""
Sep 10 12:44:40.057694 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.057658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"]
Sep 10 12:44:40.140490 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.140452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94ba23e-6460-4d23-aaf8-2e526d1f3678-openshift-service-ca\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.140649 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.140516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc5w4\" (UniqueName: \"kubernetes.io/projected/c94ba23e-6460-4d23-aaf8-2e526d1f3678-kube-api-access-xc5w4\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.140649 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.140586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.140766 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.140661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-metrics-certs\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.241387 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.241305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94ba23e-6460-4d23-aaf8-2e526d1f3678-openshift-service-ca\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.241387 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.241353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc5w4\" (UniqueName: \"kubernetes.io/projected/c94ba23e-6460-4d23-aaf8-2e526d1f3678-kube-api-access-xc5w4\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.241387 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.241380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.241612 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.241453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-metrics-certs\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.241612 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:40.241536    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-serving-cert: secret "maas-api-e2e-inf-b-714b74-serving-cert" not found
Sep 10 12:44:40.241612 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:44:40.241600    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls podName:c94ba23e-6460-4d23-aaf8-2e526d1f3678 nodeName:}" failed. No retries permitted until 2026-09-10 12:44:40.741582193 +0000 UTC m=+871.861936748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls") pod "maas-api-e2e-inf-b-714b74-7df997444-tlstq" (UID: "c94ba23e-6460-4d23-aaf8-2e526d1f3678") : secret "maas-api-e2e-inf-b-714b74-serving-cert" not found
Sep 10 12:44:40.241939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.241921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94ba23e-6460-4d23-aaf8-2e526d1f3678-openshift-service-ca\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.244071 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.244050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-metrics-certs\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.269752 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.269728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc5w4\" (UniqueName: \"kubernetes.io/projected/c94ba23e-6460-4d23-aaf8-2e526d1f3678-kube-api-access-xc5w4\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.746990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.746945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.749498 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.749467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls\") pod \"maas-api-e2e-inf-b-714b74-7df997444-tlstq\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:40.903167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:40.903129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:41.220149 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:41.220114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"]
Sep 10 12:44:41.220478 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:44:41.220351    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94ba23e_6460_4d23_aaf8_2e526d1f3678.slice/crio-9b3b65b6992afc12ccbd4f0d74cbaaa7334eaf049714365f5c7ad51e299335ab WatchSource:0}: Error finding container 9b3b65b6992afc12ccbd4f0d74cbaaa7334eaf049714365f5c7ad51e299335ab: Status 404 returned error can't find the container with id 9b3b65b6992afc12ccbd4f0d74cbaaa7334eaf049714365f5c7ad51e299335ab
Sep 10 12:44:41.336747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:41.336707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq" event={"ID":"c94ba23e-6460-4d23-aaf8-2e526d1f3678","Type":"ContainerStarted","Data":"9b3b65b6992afc12ccbd4f0d74cbaaa7334eaf049714365f5c7ad51e299335ab"}
Sep 10 12:44:42.344324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:42.344290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq" event={"ID":"c94ba23e-6460-4d23-aaf8-2e526d1f3678","Type":"ContainerStarted","Data":"b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6"}
Sep 10 12:44:42.344728 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:42.344421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:42.388545 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:42.388488    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq" podStartSLOduration=3.076270347 podStartE2EDuration="3.388468505s" totalImagesPullingTime="312.198158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:42.388119003 +0000 UTC m=+873.508473584" watchObservedRunningTime="2026-09-10 12:44:42.388468505 +0000 UTC m=+873.508823083"
Sep 10 12:44:48.355533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:48.355503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:44:59.476698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.476667    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"]
Sep 10 12:44:59.477248 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.476907    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m" podUID="c18127a0-5610-43bd-9b8b-f0049685d796" containerName="maas-api" containerID="cri-o://71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903" gracePeriod=30
Sep 10 12:44:59.741917 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.741893    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:44:59.924785 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.924751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c18127a0-5610-43bd-9b8b-f0049685d796-openshift-service-ca\") pod \"c18127a0-5610-43bd-9b8b-f0049685d796\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") "
Sep 10 12:44:59.924785 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.924801    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls\") pod \"c18127a0-5610-43bd-9b8b-f0049685d796\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") "
Sep 10 12:44:59.925121 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.924923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-metrics-certs\") pod \"c18127a0-5610-43bd-9b8b-f0049685d796\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") "
Sep 10 12:44:59.925121 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.924974    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkfgh\" (UniqueName: \"kubernetes.io/projected/c18127a0-5610-43bd-9b8b-f0049685d796-kube-api-access-vkfgh\") pod \"c18127a0-5610-43bd-9b8b-f0049685d796\" (UID: \"c18127a0-5610-43bd-9b8b-f0049685d796\") "
Sep 10 12:44:59.925253 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.925166    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c18127a0-5610-43bd-9b8b-f0049685d796-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c18127a0-5610-43bd-9b8b-f0049685d796" (UID: "c18127a0-5610-43bd-9b8b-f0049685d796"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:44:59.925406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.925388    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c18127a0-5610-43bd-9b8b-f0049685d796-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:44:59.928034 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.928003    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c18127a0-5610-43bd-9b8b-f0049685d796" (UID: "c18127a0-5610-43bd-9b8b-f0049685d796"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:44:59.928034 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.928009    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c18127a0-5610-43bd-9b8b-f0049685d796-kube-api-access-vkfgh" (OuterVolumeSpecName: "kube-api-access-vkfgh") pod "c18127a0-5610-43bd-9b8b-f0049685d796" (UID: "c18127a0-5610-43bd-9b8b-f0049685d796"). InnerVolumeSpecName "kube-api-access-vkfgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:44:59.928197 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:44:59.928068    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c18127a0-5610-43bd-9b8b-f0049685d796" (UID: "c18127a0-5610-43bd-9b8b-f0049685d796"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:45:00.025949 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.025864    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:45:00.025949 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.025898    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkfgh\" (UniqueName: \"kubernetes.io/projected/c18127a0-5610-43bd-9b8b-f0049685d796-kube-api-access-vkfgh\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:45:00.025949 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.025910    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c18127a0-5610-43bd-9b8b-f0049685d796-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:45:00.444401 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.444369    2565 generic.go:356] "Generic (PLEG): container finished" podID="c18127a0-5610-43bd-9b8b-f0049685d796" containerID="71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903" exitCode=0
Sep 10 12:45:00.444589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.444423    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"
Sep 10 12:45:00.444589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.444446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m" event={"ID":"c18127a0-5610-43bd-9b8b-f0049685d796","Type":"ContainerDied","Data":"71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903"}
Sep 10 12:45:00.444589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.444537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m" event={"ID":"c18127a0-5610-43bd-9b8b-f0049685d796","Type":"ContainerDied","Data":"4754ead91d6aa4d40dc4c168a593f9a80b39016f86520b91423e30504b5300d5"}
Sep 10 12:45:00.444589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.444566    2565 scope.go:117] "RemoveContainer" containerID="71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903"
Sep 10 12:45:00.455292 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.455273    2565 scope.go:117] "RemoveContainer" containerID="71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903"
Sep 10 12:45:00.455604 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:45:00.455585    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903\": container with ID starting with 71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903 not found: ID does not exist" containerID="71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903"
Sep 10 12:45:00.455662 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.455614    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903"} err="failed to get container status \"71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903\": rpc error: code = NotFound desc = could not find container \"71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903\": container with ID starting with 71939e0fd0ca012ea0348a5f3db61e27dec6791a6d8de5a5ea9c5588c8bf5903 not found: ID does not exist"
Sep 10 12:45:00.500425 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.500389    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"]
Sep 10 12:45:00.505442 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:00.505415    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c8b03106-854f785656-kgp6m"]
Sep 10 12:45:01.394652 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:01.394615    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c18127a0-5610-43bd-9b8b-f0049685d796" path="/var/lib/kubelet/pods/c18127a0-5610-43bd-9b8b-f0049685d796/volumes"
Sep 10 12:45:03.904122 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.904086    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"]
Sep 10 12:45:03.904665 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.904644    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c18127a0-5610-43bd-9b8b-f0049685d796" containerName="maas-api"
Sep 10 12:45:03.904772 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.904668    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c18127a0-5610-43bd-9b8b-f0049685d796" containerName="maas-api"
Sep 10 12:45:03.904772 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.904768    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c18127a0-5610-43bd-9b8b-f0049685d796" containerName="maas-api"
Sep 10 12:45:03.907800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.907779    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:03.911762 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.911738    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-760a0d05-serving-cert\""
Sep 10 12:45:03.921293 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.921049    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"]
Sep 10 12:45:03.962815 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.962774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-metrics-certs\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:03.962965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.962889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-maas-api-tls\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:03.962965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.962935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcrcb\" (UniqueName: \"kubernetes.io/projected/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-kube-api-access-wcrcb\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:03.963077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:03.962970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-openshift-service-ca\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.063859 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.063825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-maas-api-tls\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.064010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.063882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcrcb\" (UniqueName: \"kubernetes.io/projected/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-kube-api-access-wcrcb\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.064010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.063932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-openshift-service-ca\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.064010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.063975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-metrics-certs\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.064743 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.064688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-openshift-service-ca\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.066481 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.066459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-maas-api-tls\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.066588 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.066534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-metrics-certs\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.073704 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.073680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcrcb\" (UniqueName: \"kubernetes.io/projected/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-kube-api-access-wcrcb\") pod \"maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.220056 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.220022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:04.499458 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:04.499429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"]
Sep 10 12:45:04.501488 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:45:04.501466    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39457abf_ae8b_47a6_ba0b_26f773ea8cb8.slice/crio-a8236c9ee48cd2c28e04d8220c5ebf132ba8f7f1ff5b70cebec891efcc361c98 WatchSource:0}: Error finding container a8236c9ee48cd2c28e04d8220c5ebf132ba8f7f1ff5b70cebec891efcc361c98: Status 404 returned error can't find the container with id a8236c9ee48cd2c28e04d8220c5ebf132ba8f7f1ff5b70cebec891efcc361c98
Sep 10 12:45:05.473091 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:05.473058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd" event={"ID":"39457abf-ae8b-47a6-ba0b-26f773ea8cb8","Type":"ContainerStarted","Data":"a8236c9ee48cd2c28e04d8220c5ebf132ba8f7f1ff5b70cebec891efcc361c98"}
Sep 10 12:45:06.485715 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:06.485678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd" event={"ID":"39457abf-ae8b-47a6-ba0b-26f773ea8cb8","Type":"ContainerStarted","Data":"f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239"}
Sep 10 12:45:06.486100 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:06.485799    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:06.522963 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:06.522902    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd" podStartSLOduration=1.846560043 podStartE2EDuration="3.522885454s" totalImagesPullingTime="1.676325411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:45:06.521762181 +0000 UTC m=+897.642116761" watchObservedRunningTime="2026-09-10 12:45:06.522885454 +0000 UTC m=+897.643240070"
Sep 10 12:45:12.496241 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:12.496196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:35.345523 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.345490    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"]
Sep 10 12:45:35.346167 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.345721    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd" podUID="39457abf-ae8b-47a6-ba0b-26f773ea8cb8" containerName="maas-api" containerID="cri-o://f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239" gracePeriod=30
Sep 10 12:45:35.589883 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.589859    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:35.654497 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.654394    2565 generic.go:356] "Generic (PLEG): container finished" podID="39457abf-ae8b-47a6-ba0b-26f773ea8cb8" containerID="f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239" exitCode=0
Sep 10 12:45:35.654497 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.654476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd" event={"ID":"39457abf-ae8b-47a6-ba0b-26f773ea8cb8","Type":"ContainerDied","Data":"f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239"}
Sep 10 12:45:35.654734 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.654521    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"
Sep 10 12:45:35.654734 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.654539    2565 scope.go:117] "RemoveContainer" containerID="f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239"
Sep 10 12:45:35.654734 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.654526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd" event={"ID":"39457abf-ae8b-47a6-ba0b-26f773ea8cb8","Type":"ContainerDied","Data":"a8236c9ee48cd2c28e04d8220c5ebf132ba8f7f1ff5b70cebec891efcc361c98"}
Sep 10 12:45:35.664957 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.664935    2565 scope.go:117] "RemoveContainer" containerID="f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239"
Sep 10 12:45:35.665306 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:45:35.665279    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239\": container with ID starting with f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239 not found: ID does not exist" containerID="f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239"
Sep 10 12:45:35.665426 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.665317    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239"} err="failed to get container status \"f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239\": rpc error: code = NotFound desc = could not find container \"f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239\": container with ID starting with f7a4265a4d3d4e611d7a244614dba56640a99458aab570223419cdbcc1b91239 not found: ID does not exist"
Sep 10 12:45:35.769221 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.769187    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-maas-api-tls\") pod \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") "
Sep 10 12:45:35.769389 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.769279    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-openshift-service-ca\") pod \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") "
Sep 10 12:45:35.769478 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.769403    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-metrics-certs\") pod \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") "
Sep 10 12:45:35.769534 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.769506    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcrcb\" (UniqueName: \"kubernetes.io/projected/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-kube-api-access-wcrcb\") pod \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\" (UID: \"39457abf-ae8b-47a6-ba0b-26f773ea8cb8\") "
Sep 10 12:45:35.769653 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.769626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39457abf-ae8b-47a6-ba0b-26f773ea8cb8" (UID: "39457abf-ae8b-47a6-ba0b-26f773ea8cb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:45:35.769818 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.769800    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:45:35.771607 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.771582    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39457abf-ae8b-47a6-ba0b-26f773ea8cb8" (UID: "39457abf-ae8b-47a6-ba0b-26f773ea8cb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:45:35.771747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.771621    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "39457abf-ae8b-47a6-ba0b-26f773ea8cb8" (UID: "39457abf-ae8b-47a6-ba0b-26f773ea8cb8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:45:35.771917 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.771895    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-kube-api-access-wcrcb" (OuterVolumeSpecName: "kube-api-access-wcrcb") pod "39457abf-ae8b-47a6-ba0b-26f773ea8cb8" (UID: "39457abf-ae8b-47a6-ba0b-26f773ea8cb8"). InnerVolumeSpecName "kube-api-access-wcrcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:45:35.871122 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.871087    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcrcb\" (UniqueName: \"kubernetes.io/projected/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-kube-api-access-wcrcb\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:45:35.871122 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.871118    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:45:35.871122 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.871128    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39457abf-ae8b-47a6-ba0b-26f773ea8cb8-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:45:35.993657 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:35.993623    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"]
Sep 10 12:45:36.005825 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:36.005800    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-760a0d05-7b675d98b5-lmkdd"]
Sep 10 12:45:37.401378 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:37.401331    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39457abf-ae8b-47a6-ba0b-26f773ea8cb8" path="/var/lib/kubelet/pods/39457abf-ae8b-47a6-ba0b-26f773ea8cb8/volumes"
Sep 10 12:45:41.116904 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.116872    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"]
Sep 10 12:45:41.117452 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.117436    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39457abf-ae8b-47a6-ba0b-26f773ea8cb8" containerName="maas-api"
Sep 10 12:45:41.117515 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.117456    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="39457abf-ae8b-47a6-ba0b-26f773ea8cb8" containerName="maas-api"
Sep 10 12:45:41.117559 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.117534    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="39457abf-ae8b-47a6-ba0b-26f773ea8cb8" containerName="maas-api"
Sep 10 12:45:41.120455 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.120432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.123342 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.123308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d7fcd5f6-serving-cert\""
Sep 10 12:45:41.134746 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.134722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"]
Sep 10 12:45:41.221125 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.221092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8mm\" (UniqueName: \"kubernetes.io/projected/a346e895-9452-4053-84ab-648ba96b34ea-kube-api-access-ng8mm\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.221125 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.221129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-metrics-certs\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.221365 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.221191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a346e895-9452-4053-84ab-648ba96b34ea-openshift-service-ca\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.221365 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.221230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.322478 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.322445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.322673 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.322525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8mm\" (UniqueName: \"kubernetes.io/projected/a346e895-9452-4053-84ab-648ba96b34ea-kube-api-access-ng8mm\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.322673 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.322551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-metrics-certs\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.322673 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:45:41.322593    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-serving-cert: secret "maas-api-e2e-ait-d7fcd5f6-serving-cert" not found
Sep 10 12:45:41.322673 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.322605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a346e895-9452-4053-84ab-648ba96b34ea-openshift-service-ca\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.322673 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:45:41.322669    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls podName:a346e895-9452-4053-84ab-648ba96b34ea nodeName:}" failed. No retries permitted until 2026-09-10 12:45:41.822648265 +0000 UTC m=+932.943002845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls") pod "maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n" (UID: "a346e895-9452-4053-84ab-648ba96b34ea") : secret "maas-api-e2e-ait-d7fcd5f6-serving-cert" not found
Sep 10 12:45:41.323308 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.323291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a346e895-9452-4053-84ab-648ba96b34ea-openshift-service-ca\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.325096 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.325081    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-metrics-certs\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.334613 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.334586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8mm\" (UniqueName: \"kubernetes.io/projected/a346e895-9452-4053-84ab-648ba96b34ea-kube-api-access-ng8mm\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.826855 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.826801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:41.829475 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:41.829447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls\") pod \"maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:42.031685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:42.031652    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:42.310195 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:42.310166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"]
Sep 10 12:45:42.311403 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:45:42.311377    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda346e895_9452_4053_84ab_648ba96b34ea.slice/crio-56c11a52cb76722241a3c2ffd9c783e06a42d84224b3eec4879522277a79a8b1 WatchSource:0}: Error finding container 56c11a52cb76722241a3c2ffd9c783e06a42d84224b3eec4879522277a79a8b1: Status 404 returned error can't find the container with id 56c11a52cb76722241a3c2ffd9c783e06a42d84224b3eec4879522277a79a8b1
Sep 10 12:45:42.312763 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:42.312747    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:45:42.695037 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:42.694997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n" event={"ID":"a346e895-9452-4053-84ab-648ba96b34ea","Type":"ContainerStarted","Data":"56c11a52cb76722241a3c2ffd9c783e06a42d84224b3eec4879522277a79a8b1"}
Sep 10 12:45:43.701687 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:43.701649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n" event={"ID":"a346e895-9452-4053-84ab-648ba96b34ea","Type":"ContainerStarted","Data":"0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d"}
Sep 10 12:45:43.702112 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:43.701766    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:45:43.725786 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:43.725733    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n" podStartSLOduration=2.077526483 podStartE2EDuration="2.725717324s" totalImagesPullingTime="648.190841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:45:43.722886415 +0000 UTC m=+934.843240991" watchObservedRunningTime="2026-09-10 12:45:43.725717324 +0000 UTC m=+934.846071900"
Sep 10 12:45:49.712059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:45:49.712031    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:46:10.891770 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:10.891733    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"]
Sep 10 12:46:10.892189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:10.891952    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl" podUID="1c525f02-5ae0-42cd-9876-018d670d34e0" containerName="maas-api" containerID="cri-o://771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f" gracePeriod=30
Sep 10 12:46:11.142184 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.142128    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:46:11.315713 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.315677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59wwn\" (UniqueName: \"kubernetes.io/projected/1c525f02-5ae0-42cd-9876-018d670d34e0-kube-api-access-59wwn\") pod \"1c525f02-5ae0-42cd-9876-018d670d34e0\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") "
Sep 10 12:46:11.315713 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.315721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-maas-api-tls\") pod \"1c525f02-5ae0-42cd-9876-018d670d34e0\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") "
Sep 10 12:46:11.315973 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.315787    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-metrics-certs\") pod \"1c525f02-5ae0-42cd-9876-018d670d34e0\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") "
Sep 10 12:46:11.315973 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.315829    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c525f02-5ae0-42cd-9876-018d670d34e0-openshift-service-ca\") pod \"1c525f02-5ae0-42cd-9876-018d670d34e0\" (UID: \"1c525f02-5ae0-42cd-9876-018d670d34e0\") "
Sep 10 12:46:11.316495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.316443    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c525f02-5ae0-42cd-9876-018d670d34e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1c525f02-5ae0-42cd-9876-018d670d34e0" (UID: "1c525f02-5ae0-42cd-9876-018d670d34e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:46:11.319606 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.319579    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1c525f02-5ae0-42cd-9876-018d670d34e0" (UID: "1c525f02-5ae0-42cd-9876-018d670d34e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:46:11.319738 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.319650    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1c525f02-5ae0-42cd-9876-018d670d34e0" (UID: "1c525f02-5ae0-42cd-9876-018d670d34e0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:46:11.319738 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.319706    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c525f02-5ae0-42cd-9876-018d670d34e0-kube-api-access-59wwn" (OuterVolumeSpecName: "kube-api-access-59wwn") pod "1c525f02-5ae0-42cd-9876-018d670d34e0" (UID: "1c525f02-5ae0-42cd-9876-018d670d34e0"). InnerVolumeSpecName "kube-api-access-59wwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:46:11.417551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.417523    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:11.417551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.417551    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c525f02-5ae0-42cd-9876-018d670d34e0-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:11.417723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.417566    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59wwn\" (UniqueName: \"kubernetes.io/projected/1c525f02-5ae0-42cd-9876-018d670d34e0-kube-api-access-59wwn\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:11.417723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.417577    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c525f02-5ae0-42cd-9876-018d670d34e0-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:11.846607 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.846572    2565 generic.go:356] "Generic (PLEG): container finished" podID="1c525f02-5ae0-42cd-9876-018d670d34e0" containerID="771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f" exitCode=0
Sep 10 12:46:11.846773 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.846621    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"
Sep 10 12:46:11.846773 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.846659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl" event={"ID":"1c525f02-5ae0-42cd-9876-018d670d34e0","Type":"ContainerDied","Data":"771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f"}
Sep 10 12:46:11.846773 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.846714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl" event={"ID":"1c525f02-5ae0-42cd-9876-018d670d34e0","Type":"ContainerDied","Data":"eecb4c82c291e7a75db6422d9b65c26bedc94bfeeedc350e21948a24c04a59f8"}
Sep 10 12:46:11.846773 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.846747    2565 scope.go:117] "RemoveContainer" containerID="771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f"
Sep 10 12:46:11.857569 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.857550    2565 scope.go:117] "RemoveContainer" containerID="771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f"
Sep 10 12:46:11.857874 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:46:11.857845    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f\": container with ID starting with 771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f not found: ID does not exist" containerID="771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f"
Sep 10 12:46:11.857954 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.857891    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f"} err="failed to get container status \"771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f\": rpc error: code = NotFound desc = could not find container \"771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f\": container with ID starting with 771db3628a7a0eb1289609e2f6ed6682321e97ed4b971a89b6bfc2891369a02f not found: ID does not exist"
Sep 10 12:46:11.909929 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.909900    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"]
Sep 10 12:46:11.925983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:11.925956    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5abff0-64688d988-gqmnl"]
Sep 10 12:46:12.362277 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.361263    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"]
Sep 10 12:46:12.362277 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.361598    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n" podUID="a346e895-9452-4053-84ab-648ba96b34ea" containerName="maas-api" containerID="cri-o://0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d" gracePeriod=30
Sep 10 12:46:12.617224 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.617141    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:46:12.730550 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.730517    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng8mm\" (UniqueName: \"kubernetes.io/projected/a346e895-9452-4053-84ab-648ba96b34ea-kube-api-access-ng8mm\") pod \"a346e895-9452-4053-84ab-648ba96b34ea\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") "
Sep 10 12:46:12.730550 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.730552    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a346e895-9452-4053-84ab-648ba96b34ea-openshift-service-ca\") pod \"a346e895-9452-4053-84ab-648ba96b34ea\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") "
Sep 10 12:46:12.730783 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.730588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls\") pod \"a346e895-9452-4053-84ab-648ba96b34ea\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") "
Sep 10 12:46:12.730783 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.730642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-metrics-certs\") pod \"a346e895-9452-4053-84ab-648ba96b34ea\" (UID: \"a346e895-9452-4053-84ab-648ba96b34ea\") "
Sep 10 12:46:12.730986 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.730958    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a346e895-9452-4053-84ab-648ba96b34ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a346e895-9452-4053-84ab-648ba96b34ea" (UID: "a346e895-9452-4053-84ab-648ba96b34ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:46:12.732794 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.732764    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a346e895-9452-4053-84ab-648ba96b34ea" (UID: "a346e895-9452-4053-84ab-648ba96b34ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:46:12.732891 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.732796    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a346e895-9452-4053-84ab-648ba96b34ea" (UID: "a346e895-9452-4053-84ab-648ba96b34ea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:46:12.732933 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.732882    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a346e895-9452-4053-84ab-648ba96b34ea-kube-api-access-ng8mm" (OuterVolumeSpecName: "kube-api-access-ng8mm") pod "a346e895-9452-4053-84ab-648ba96b34ea" (UID: "a346e895-9452-4053-84ab-648ba96b34ea"). InnerVolumeSpecName "kube-api-access-ng8mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:46:12.831790 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.831756    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng8mm\" (UniqueName: \"kubernetes.io/projected/a346e895-9452-4053-84ab-648ba96b34ea-kube-api-access-ng8mm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:12.831790 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.831785    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a346e895-9452-4053-84ab-648ba96b34ea-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:12.831790 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.831796    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:12.832014 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.831804    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a346e895-9452-4053-84ab-648ba96b34ea-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:12.853820 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.853790    2565 generic.go:356] "Generic (PLEG): container finished" podID="a346e895-9452-4053-84ab-648ba96b34ea" containerID="0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d" exitCode=0
Sep 10 12:46:12.853957 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.853841    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"
Sep 10 12:46:12.853957 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.853864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n" event={"ID":"a346e895-9452-4053-84ab-648ba96b34ea","Type":"ContainerDied","Data":"0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d"}
Sep 10 12:46:12.853957 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.853914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n" event={"ID":"a346e895-9452-4053-84ab-648ba96b34ea","Type":"ContainerDied","Data":"56c11a52cb76722241a3c2ffd9c783e06a42d84224b3eec4879522277a79a8b1"}
Sep 10 12:46:12.853957 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.853936    2565 scope.go:117] "RemoveContainer" containerID="0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d"
Sep 10 12:46:12.863651 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.863632    2565 scope.go:117] "RemoveContainer" containerID="0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d"
Sep 10 12:46:12.863919 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:46:12.863899    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d\": container with ID starting with 0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d not found: ID does not exist" containerID="0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d"
Sep 10 12:46:12.863981 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.863933    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d"} err="failed to get container status \"0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d\": rpc error: code = NotFound desc = could not find container \"0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d\": container with ID starting with 0d1d1b31119bd85787d472679d2bd829fa34f8d3d2bf94db171d9772e68ee89d not found: ID does not exist"
Sep 10 12:46:12.876927 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.876874    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"]
Sep 10 12:46:12.880923 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:12.880902    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7fcd5f6-84bb599c46-cgp6n"]
Sep 10 12:46:13.395976 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:13.395945    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c525f02-5ae0-42cd-9876-018d670d34e0" path="/var/lib/kubelet/pods/1c525f02-5ae0-42cd-9876-018d670d34e0/volumes"
Sep 10 12:46:13.396371 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:13.396345    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a346e895-9452-4053-84ab-648ba96b34ea" path="/var/lib/kubelet/pods/a346e895-9452-4053-84ab-648ba96b34ea/volumes"
Sep 10 12:46:14.563770 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.563738    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"]
Sep 10 12:46:14.564137 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.564072    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a346e895-9452-4053-84ab-648ba96b34ea" containerName="maas-api"
Sep 10 12:46:14.564137 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.564083    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a346e895-9452-4053-84ab-648ba96b34ea" containerName="maas-api"
Sep 10 12:46:14.564137 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.564102    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c525f02-5ae0-42cd-9876-018d670d34e0" containerName="maas-api"
Sep 10 12:46:14.564137 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.564107    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c525f02-5ae0-42cd-9876-018d670d34e0" containerName="maas-api"
Sep 10 12:46:14.564293 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.564159    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c525f02-5ae0-42cd-9876-018d670d34e0" containerName="maas-api"
Sep 10 12:46:14.564293 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.564169    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a346e895-9452-4053-84ab-648ba96b34ea" containerName="maas-api"
Sep 10 12:46:14.568577 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.568561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.571292 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.571271    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3eca8974-openshift-default-dockercfg-8g4dc\""
Sep 10 12:46:14.580646 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.580624    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"]
Sep 10 12:46:14.749699 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-certs\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.749699 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-token\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.749921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istiod-ca-cert\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.749921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-data\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.749921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-credential-socket\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.749921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-envoy\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.749921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-podinfo\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.750083 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4kw9\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-kube-api-access-r4kw9\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.750083 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.749982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-socket\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850542 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-certs\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850542 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-token\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850542 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istiod-ca-cert\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-data\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-credential-socket\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-envoy\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-podinfo\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4kw9\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-kube-api-access-r4kw9\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.850803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-socket\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.851196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-certs\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.851196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.850986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-credential-socket\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.851347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.851200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-socket\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.851347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.851294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-data\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.851613 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.851380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istiod-ca-cert\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.853106 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.853085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-envoy\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.853382 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.853364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-podinfo\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.868641 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.868608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-token\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.869479 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.869456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4kw9\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-kube-api-access-r4kw9\") pod \"e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") " pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:14.879344 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:14.879318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:15.161666 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.161633    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"]
Sep 10 12:46:15.162044 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:46:15.162021    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4c25b0_edcc_482a_a039_65efdadc7eb7.slice/crio-db9600b694e7ba768dfaf011bf4c26852411a51546523d6f4f7419c36b7d280b WatchSource:0}: Error finding container db9600b694e7ba768dfaf011bf4c26852411a51546523d6f4f7419c36b7d280b: Status 404 returned error can't find the container with id db9600b694e7ba768dfaf011bf4c26852411a51546523d6f4f7419c36b7d280b
Sep 10 12:46:15.164225 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.164177    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:15.164323 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.164277    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:15.164323 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.164305    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:15.874855 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.874820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" event={"ID":"fd4c25b0-edcc-482a-a039-65efdadc7eb7","Type":"ContainerStarted","Data":"6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a"}
Sep 10 12:46:15.875244 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.874875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" event={"ID":"fd4c25b0-edcc-482a-a039-65efdadc7eb7","Type":"ContainerStarted","Data":"db9600b694e7ba768dfaf011bf4c26852411a51546523d6f4f7419c36b7d280b"}
Sep 10 12:46:15.879612 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.879591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:15.912177 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:15.912126    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podStartSLOduration=1.9121100960000001 podStartE2EDuration="1.912110096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:15.908577406 +0000 UTC m=+967.028931984" watchObservedRunningTime="2026-09-10 12:46:15.912110096 +0000 UTC m=+967.032464670"
Sep 10 12:46:16.884532 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:16.884499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:17.886179 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:17.886150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:17.887188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:17.887168    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:18.502645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.502605    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"]
Sep 10 12:46:18.506111 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.506091    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.509520 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.509502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3eca8974-serving-cert\""
Sep 10 12:46:18.524762 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.524739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"]
Sep 10 12:46:18.588239 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.588179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-openshift-service-ca\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.588405 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.588301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-568pv\" (UniqueName: \"kubernetes.io/projected/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-kube-api-access-568pv\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.588405 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.588339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-metrics-certs\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.588405 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.588362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.688966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.688918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-openshift-service-ca\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.689146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.689028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-568pv\" (UniqueName: \"kubernetes.io/projected/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-kube-api-access-568pv\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.689146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.689087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-metrics-certs\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.689146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.689117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.689366 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:46:18.689342    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-serving-cert: secret "maas-api-e2e-derive-3eca8974-serving-cert" not found
Sep 10 12:46:18.689449 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:46:18.689424    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls podName:3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:19.189404299 +0000 UTC m=+970.309758868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls") pod "maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8" (UID: "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826") : secret "maas-api-e2e-derive-3eca8974-serving-cert" not found
Sep 10 12:46:18.690190 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.690157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-openshift-service-ca\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.692117 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.692095    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-metrics-certs\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:18.701712 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:18.701691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-568pv\" (UniqueName: \"kubernetes.io/projected/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-kube-api-access-568pv\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:19.193785 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:19.193753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:19.196392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:19.196366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls\") pod \"maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:19.419715 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:19.418535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:19.723020 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:19.722988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"]
Sep 10 12:46:19.723812 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:46:19.723784    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc351e6_dc96_4d21_8d0e_8a1ddeb3b826.slice/crio-981a14a778ce168f46fcaf4a0d0cf041c2a8910169618d2d891e84123d172981 WatchSource:0}: Error finding container 981a14a778ce168f46fcaf4a0d0cf041c2a8910169618d2d891e84123d172981: Status 404 returned error can't find the container with id 981a14a778ce168f46fcaf4a0d0cf041c2a8910169618d2d891e84123d172981
Sep 10 12:46:19.897271 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:19.897156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8" event={"ID":"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826","Type":"ContainerStarted","Data":"981a14a778ce168f46fcaf4a0d0cf041c2a8910169618d2d891e84123d172981"}
Sep 10 12:46:20.905768 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:20.905726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8" event={"ID":"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826","Type":"ContainerStarted","Data":"a33a84e3d7f890ec5c248bdd0143bdecd85dbef3a8ea2569dec987e31190ab58"}
Sep 10 12:46:20.906314 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:20.905803    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:20.935565 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:20.935498    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8" podStartSLOduration=2.493654475 podStartE2EDuration="2.935482381s" totalImagesPullingTime="441.827906ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:20.933546191 +0000 UTC m=+972.053900770" watchObservedRunningTime="2026-09-10 12:46:20.935482381 +0000 UTC m=+972.055836979"
Sep 10 12:46:26.916687 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:26.916657    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:42.026759 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:42.026719    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerID="6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a" exitCode=0
Sep 10 12:46:42.027298 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:42.026805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" event={"ID":"fd4c25b0-edcc-482a-a039-65efdadc7eb7","Type":"ContainerDied","Data":"6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a"}
Sep 10 12:46:42.027392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:42.027299    2565 scope.go:117] "RemoveContainer" containerID="6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a"
Sep 10 12:46:42.028446 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:42.028417    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:42.028540 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:42.028481    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:42.028540 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:42.028514    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:43.034322 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:43.034284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" event={"ID":"fd4c25b0-edcc-482a-a039-65efdadc7eb7","Type":"ContainerStarted","Data":"7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5"}
Sep 10 12:46:43.880010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:43.879976    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:43.881103 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:43.881075    2565 patch_prober.go:28] interesting pod/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 12:46:43.881253 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:43.881124    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 12:46:44.880651 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:44.880614    2565 patch_prober.go:28] interesting pod/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 12:46:44.881042 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:44.880671    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 12:46:45.879731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:45.879698    2565 patch_prober.go:28] interesting pod/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 12:46:45.879915 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:45.879752    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 12:46:46.880134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:46.880094    2565 patch_prober.go:28] interesting pod/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 12:46:46.880557 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:46.880162    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 12:46:47.880026 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:47.879990    2565 patch_prober.go:28] interesting pod/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 12:46:47.880243 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:47.880047    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 12:46:47.886143 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:47.886101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:48.880039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:48.880004    2565 patch_prober.go:28] interesting pod/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 12:46:48.880186 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:48.880062    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 12:46:49.855695 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:49.855663    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"]
Sep 10 12:46:49.856231 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:49.855905    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8" podUID="3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" containerName="maas-api" containerID="cri-o://a33a84e3d7f890ec5c248bdd0143bdecd85dbef3a8ea2569dec987e31190ab58" gracePeriod=30
Sep 10 12:46:49.884358 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:49.884325    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:49.885385 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:49.885362    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:50.075348 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.075310    2565 generic.go:356] "Generic (PLEG): container finished" podID="3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" containerID="a33a84e3d7f890ec5c248bdd0143bdecd85dbef3a8ea2569dec987e31190ab58" exitCode=0
Sep 10 12:46:50.075348 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.075342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8" event={"ID":"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826","Type":"ContainerDied","Data":"a33a84e3d7f890ec5c248bdd0143bdecd85dbef3a8ea2569dec987e31190ab58"}
Sep 10 12:46:50.120395 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.120329    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:50.196388 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.196352    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-568pv\" (UniqueName: \"kubernetes.io/projected/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-kube-api-access-568pv\") pod \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") "
Sep 10 12:46:50.196586 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.196419    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-metrics-certs\") pod \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") "
Sep 10 12:46:50.196586 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.196479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-openshift-service-ca\") pod \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") "
Sep 10 12:46:50.196586 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.196502    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls\") pod \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\" (UID: \"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826\") "
Sep 10 12:46:50.197041 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.196866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" (UID: "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:46:50.198594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.198571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-kube-api-access-568pv" (OuterVolumeSpecName: "kube-api-access-568pv") pod "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" (UID: "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826"). InnerVolumeSpecName "kube-api-access-568pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:46:50.199081 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.199049    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" (UID: "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:46:50.199081 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.199071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" (UID: "3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:46:50.297959 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.297925    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:50.297959 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.297956    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:50.297959 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.297965    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-568pv\" (UniqueName: \"kubernetes.io/projected/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-kube-api-access-568pv\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:50.298173 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.297974    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:50.526921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:50.523648    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"]
Sep 10 12:46:51.082023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:51.081989    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"
Sep 10 12:46:51.082023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:51.082009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8" event={"ID":"3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826","Type":"ContainerDied","Data":"981a14a778ce168f46fcaf4a0d0cf041c2a8910169618d2d891e84123d172981"}
Sep 10 12:46:51.082596 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:51.082079    2565 scope.go:117] "RemoveContainer" containerID="a33a84e3d7f890ec5c248bdd0143bdecd85dbef3a8ea2569dec987e31190ab58"
Sep 10 12:46:51.082596 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:51.082399    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy" containerID="cri-o://7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5" gracePeriod=30
Sep 10 12:46:51.139038 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:51.139007    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"]
Sep 10 12:46:51.147087 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:51.147059    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3eca8974-5f8cb54f6d-6q9l8"]
Sep 10 12:46:51.394961 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:51.394887    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" path="/var/lib/kubelet/pods/3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826/volumes"
Sep 10 12:46:56.328018 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.327991    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:56.452900 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.452873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-token\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453060 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.452915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-socket\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453060 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.452942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4kw9\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-kube-api-access-r4kw9\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istiod-ca-cert\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453183 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-data\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453257 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453225    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-envoy\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453303 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-credential-socket\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453303 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:46:56.453303 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-podinfo\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453462 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-certs\") pod \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\" (UID: \"fd4c25b0-edcc-482a-a039-65efdadc7eb7\") "
Sep 10 12:46:56.453462 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453438    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:46:56.453635 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453579    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:46:56.453635 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453574    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:46:56.453849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453695    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.453849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453711    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.453849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453812    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.453849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453827    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.453849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.453791    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:46:56.455480 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.455444    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-kube-api-access-r4kw9" (OuterVolumeSpecName: "kube-api-access-r4kw9") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "kube-api-access-r4kw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:46:56.455694 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.455671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:46:56.455796 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.455777    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:46:56.455838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.455823    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd4c25b0-edcc-482a-a039-65efdadc7eb7" (UID: "fd4c25b0-edcc-482a-a039-65efdadc7eb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:46:56.555124 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.555088    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.555124 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.555117    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.555124 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.555126    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.555124 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.555133    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4kw9\" (UniqueName: \"kubernetes.io/projected/fd4c25b0-edcc-482a-a039-65efdadc7eb7-kube-api-access-r4kw9\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:56.555434 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:56.555143    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd4c25b0-edcc-482a-a039-65efdadc7eb7-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:46:57.120364 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.120325    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerID="7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5" exitCode=0
Sep 10 12:46:57.120553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.120375    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"
Sep 10 12:46:57.120553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.120402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" event={"ID":"fd4c25b0-edcc-482a-a039-65efdadc7eb7","Type":"ContainerDied","Data":"7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5"}
Sep 10 12:46:57.120553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.120458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld" event={"ID":"fd4c25b0-edcc-482a-a039-65efdadc7eb7","Type":"ContainerDied","Data":"db9600b694e7ba768dfaf011bf4c26852411a51546523d6f4f7419c36b7d280b"}
Sep 10 12:46:57.120553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.120487    2565 scope.go:117] "RemoveContainer" containerID="7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5"
Sep 10 12:46:57.130476 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.130456    2565 scope.go:117] "RemoveContainer" containerID="6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a"
Sep 10 12:46:57.140948 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.140929    2565 scope.go:117] "RemoveContainer" containerID="7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5"
Sep 10 12:46:57.141263 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:46:57.141242    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5\": container with ID starting with 7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5 not found: ID does not exist" containerID="7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5"
Sep 10 12:46:57.141360 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.141275    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5"} err="failed to get container status \"7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5\": rpc error: code = NotFound desc = could not find container \"7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5\": container with ID starting with 7951da9d075ca283fcbc1eb68be22d43fdca514056c116ed4c846084f5a464e5 not found: ID does not exist"
Sep 10 12:46:57.141360 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.141299    2565 scope.go:117] "RemoveContainer" containerID="6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a"
Sep 10 12:46:57.141607 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:46:57.141589    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a\": container with ID starting with 6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a not found: ID does not exist" containerID="6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a"
Sep 10 12:46:57.141649 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.141615    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a"} err="failed to get container status \"6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a\": rpc error: code = NotFound desc = could not find container \"6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a\": container with ID starting with 6f601e7a6845e885a1571eb6171736c342e1028822dd5209ec11f302ffd56e8a not found: ID does not exist"
Sep 10 12:46:57.167266 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.167241    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"]
Sep 10 12:46:57.171401 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.171375    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3eca8974-openshift-default-566d88f4cb-mnbld"]
Sep 10 12:46:57.394600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:57.394521    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" path="/var/lib/kubelet/pods/fd4c25b0-edcc-482a-a039-65efdadc7eb7/volumes"
Sep 10 12:46:58.374882 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.374849    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"]
Sep 10 12:46:58.375245 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.375233    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" containerName="maas-api"
Sep 10 12:46:58.375295 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.375247    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" containerName="maas-api"
Sep 10 12:46:58.375295 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.375260    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy"
Sep 10 12:46:58.375295 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.375265    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy"
Sep 10 12:46:58.375402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.375320    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy"
Sep 10 12:46:58.375402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.375339    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc351e6-dc96-4d21-8d0e-8a1ddeb3b826" containerName="maas-api"
Sep 10 12:46:58.379947 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.379931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.385072 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.385048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-2d4635-openshift-default-dockercfg-njmv7\""
Sep 10 12:46:58.472375 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-socket\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c5dt\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-kube-api-access-5c5dt\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-credential-socket\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-data\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-podinfo\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istiod-ca-cert\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-certs\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-envoy\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.472832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.472665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-token\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.511537 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.511504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"]
Sep 10 12:46:58.573907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.573864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c5dt\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-kube-api-access-5c5dt\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.574593 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.574571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-credential-socket\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575176 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-data\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575370 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-credential-socket\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575498 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-podinfo\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575498 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istiod-ca-cert\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-certs\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-envoy\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-token\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575856 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-data\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.575930 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.575906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-socket\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.576376 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.576352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-socket\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.576645 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.576622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-certs\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.576849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.576707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istiod-ca-cert\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.578598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.578579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-podinfo\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.578842 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.578823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-envoy\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.605844 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.605820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-token\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.618010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.617984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c5dt\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-kube-api-access-5c5dt\") pod \"e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") " pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:58.690337 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:58.690305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:46:59.137306 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:59.137234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"]
Sep 10 12:46:59.183605 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:46:59.183577    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c8a4c7_2f4a_412b_9d1e_6da6614652fd.slice/crio-5d20a9c578c730c10ceac1d429944d12493b6a897fe2320d841c95aa1c24c7ee WatchSource:0}: Error finding container 5d20a9c578c730c10ceac1d429944d12493b6a897fe2320d841c95aa1c24c7ee: Status 404 returned error can't find the container with id 5d20a9c578c730c10ceac1d429944d12493b6a897fe2320d841c95aa1c24c7ee
Sep 10 12:46:59.185736 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:59.185702    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:59.185803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:59.185774    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:46:59.185803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:46:59.185800    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:47:00.139965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:00.139926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" event={"ID":"05c8a4c7-2f4a-412b-9d1e-6da6614652fd","Type":"ContainerStarted","Data":"7136d402963a1a6f9db98c629b4d82e49d89b143cb176070571ec07c5f979ad1"}
Sep 10 12:47:00.140432 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:00.139983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" event={"ID":"05c8a4c7-2f4a-412b-9d1e-6da6614652fd","Type":"ContainerStarted","Data":"5d20a9c578c730c10ceac1d429944d12493b6a897fe2320d841c95aa1c24c7ee"}
Sep 10 12:47:00.242247 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:00.242156    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podStartSLOduration=2.242138272 podStartE2EDuration="2.242138272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:00.240403672 +0000 UTC m=+1011.360758250" watchObservedRunningTime="2026-09-10 12:47:00.242138272 +0000 UTC m=+1011.362492849"
Sep 10 12:47:00.690941 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:00.690912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:47:00.696178 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:00.696155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:47:01.145743 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:01.145664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:47:01.146547 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:01.146530    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:47:03.580312 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.580273    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"]
Sep 10 12:47:03.580671 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.580645    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy"
Sep 10 12:47:03.580671 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.580655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy"
Sep 10 12:47:03.580746 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.580714    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd4c25b0-edcc-482a-a039-65efdadc7eb7" containerName="istio-proxy"
Sep 10 12:47:03.583891 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.583871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.587166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.587145    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-2d4635-serving-cert\""
Sep 10 12:47:03.599549 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.599526    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"]
Sep 10 12:47:03.623029 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.622995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbqlh\" (UniqueName: \"kubernetes.io/projected/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-kube-api-access-pbqlh\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.623180 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.623095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-metrics-certs\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.623180 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.623129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.623301 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.623243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-maas-api-tls\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.724001 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.723961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-metrics-certs\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.724001 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.724002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.724275 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.724058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-maas-api-tls\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.724275 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.724078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbqlh\" (UniqueName: \"kubernetes.io/projected/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-kube-api-access-pbqlh\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.724795 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.724772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-openshift-service-ca\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.726610 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.726591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-metrics-certs\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.726693 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.726637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-maas-api-tls\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.734721 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.734695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbqlh\" (UniqueName: \"kubernetes.io/projected/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-kube-api-access-pbqlh\") pod \"maas-api-e2e-explicit-2d4635-79649b846c-8hv2n\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:03.894670 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:03.894585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:04.181059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:04.181029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"]
Sep 10 12:47:04.182481 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:47:04.182452    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d9d4f5_7b69_465a_a87c_61f04a4ad9bc.slice/crio-aaa12d49d13e1698049e64b152598b61bcab9369ec79b085e587ad2c3e1ba994 WatchSource:0}: Error finding container aaa12d49d13e1698049e64b152598b61bcab9369ec79b085e587ad2c3e1ba994: Status 404 returned error can't find the container with id aaa12d49d13e1698049e64b152598b61bcab9369ec79b085e587ad2c3e1ba994
Sep 10 12:47:05.169188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:05.169155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n" event={"ID":"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc","Type":"ContainerStarted","Data":"2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36"}
Sep 10 12:47:05.169594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:05.169222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n" event={"ID":"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc","Type":"ContainerStarted","Data":"aaa12d49d13e1698049e64b152598b61bcab9369ec79b085e587ad2c3e1ba994"}
Sep 10 12:47:05.169594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:05.169296    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:05.301646 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:05.301556    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n" podStartSLOduration=1.99421603 podStartE2EDuration="2.301534825s" totalImagesPullingTime="307.318795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:05.300813684 +0000 UTC m=+1016.421168264" watchObservedRunningTime="2026-09-10 12:47:05.301534825 +0000 UTC m=+1016.421889405"
Sep 10 12:47:11.180083 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:11.180050    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:47:28.293592 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:28.293562    2565 generic.go:356] "Generic (PLEG): container finished" podID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerID="7136d402963a1a6f9db98c629b4d82e49d89b143cb176070571ec07c5f979ad1" exitCode=0
Sep 10 12:47:28.294017 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:28.293637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" event={"ID":"05c8a4c7-2f4a-412b-9d1e-6da6614652fd","Type":"ContainerDied","Data":"7136d402963a1a6f9db98c629b4d82e49d89b143cb176070571ec07c5f979ad1"}
Sep 10 12:47:28.294065 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:28.294017    2565 scope.go:117] "RemoveContainer" containerID="7136d402963a1a6f9db98c629b4d82e49d89b143cb176070571ec07c5f979ad1"
Sep 10 12:47:28.295133 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:28.295103    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:47:28.295307 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:28.295228    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:47:28.295307 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:28.295281    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:47:29.308911 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:29.308868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" event={"ID":"05c8a4c7-2f4a-412b-9d1e-6da6614652fd","Type":"ContainerStarted","Data":"f742c18a159e249c192a7ef5fbe3b7d22f357dfb2b702f113be56a1152977e00"}
Sep 10 12:47:29.691452 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:29.691420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:47:29.693044 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:29.693012    2565 patch_prober.go:28] interesting pod/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:47:29.693281 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:29.693253    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 10 12:47:30.691694 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:30.691645    2565 patch_prober.go:28] interesting pod/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:47:30.692375 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:30.692344    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 10 12:47:31.146256 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:31.146158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:47:31.690769 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:31.690725    2565 patch_prober.go:28] interesting pod/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:47:31.690973 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:31.690803    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 10 12:47:32.690949 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:32.690910    2565 patch_prober.go:28] interesting pod/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:47:32.691586 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:32.691551    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 10 12:47:33.691612 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:33.691569    2565 patch_prober.go:28] interesting pod/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:47:33.692105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:33.691641    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 10 12:47:34.695516 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:34.695489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:47:34.696639 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:47:34.696616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:48:34.814590 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:34.814555    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"]
Sep 10 12:48:34.815166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:34.814780    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n" podUID="83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" containerName="maas-api" containerID="cri-o://2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36" gracePeriod=30
Sep 10 12:48:35.069036 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.068972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:48:35.108085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.108051    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-metrics-certs\") pod \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") "
Sep 10 12:48:35.108316 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.108133    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-maas-api-tls\") pod \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") "
Sep 10 12:48:35.108316 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.108186    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbqlh\" (UniqueName: \"kubernetes.io/projected/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-kube-api-access-pbqlh\") pod \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") "
Sep 10 12:48:35.108448 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.108341    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-openshift-service-ca\") pod \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\" (UID: \"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc\") "
Sep 10 12:48:35.108729 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.108695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" (UID: "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:48:35.110990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.110963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" (UID: "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:48:35.110990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.110977    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" (UID: "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:48:35.111302 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.111283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-kube-api-access-pbqlh" (OuterVolumeSpecName: "kube-api-access-pbqlh") pod "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" (UID: "83d9d4f5-7b69-465a-a87c-61f04a4ad9bc"). InnerVolumeSpecName "kube-api-access-pbqlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:48:35.210040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.210009    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:35.210040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.210038    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbqlh\" (UniqueName: \"kubernetes.io/projected/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-kube-api-access-pbqlh\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:35.210040 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.210048    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:35.210377 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.210057    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:35.653784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.653697    2565 generic.go:356] "Generic (PLEG): container finished" podID="83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" containerID="2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36" exitCode=0
Sep 10 12:48:35.653784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.653740    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"
Sep 10 12:48:35.653965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.653779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n" event={"ID":"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc","Type":"ContainerDied","Data":"2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36"}
Sep 10 12:48:35.653965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.653835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n" event={"ID":"83d9d4f5-7b69-465a-a87c-61f04a4ad9bc","Type":"ContainerDied","Data":"aaa12d49d13e1698049e64b152598b61bcab9369ec79b085e587ad2c3e1ba994"}
Sep 10 12:48:35.653965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.653862    2565 scope.go:117] "RemoveContainer" containerID="2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36"
Sep 10 12:48:35.662921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.662903    2565 scope.go:117] "RemoveContainer" containerID="2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36"
Sep 10 12:48:35.663232 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:48:35.663195    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36\": container with ID starting with 2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36 not found: ID does not exist" containerID="2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36"
Sep 10 12:48:35.663300 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.663260    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36"} err="failed to get container status \"2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36\": rpc error: code = NotFound desc = could not find container \"2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36\": container with ID starting with 2ead29d8b5b8a5ce21734bb4c0fe2049e39388433159283d7ec5961da1c14f36 not found: ID does not exist"
Sep 10 12:48:35.694294 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.694264    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"]
Sep 10 12:48:35.700521 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:35.700500    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2d4635-79649b846c-8hv2n"]
Sep 10 12:48:37.395203 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:37.395168    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" path="/var/lib/kubelet/pods/83d9d4f5-7b69-465a-a87c-61f04a4ad9bc/volumes"
Sep 10 12:48:41.172855 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.172824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"]
Sep 10 12:48:41.173238 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.173175    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" containerName="maas-api"
Sep 10 12:48:41.173238 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.173187    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" containerName="maas-api"
Sep 10 12:48:41.173324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.173294    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="83d9d4f5-7b69-465a-a87c-61f04a4ad9bc" containerName="maas-api"
Sep 10 12:48:41.176495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.176475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.179981 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.179958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-006b1977-openshift-default-dockercfg-zmvpp\""
Sep 10 12:48:41.201678 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.201654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"]
Sep 10 12:48:41.271129 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-podinfo\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271129 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-certs\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-credential-socket\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istiod-ca-cert\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-envoy\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p72sb\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-kube-api-access-p72sb\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-token\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-socket\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.271669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.271603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-data\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.372897 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.372854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-token\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.372897 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.372896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-socket\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.372916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-data\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.372936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-podinfo\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.372956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-certs\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.372980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-credential-socket\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istiod-ca-cert\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-envoy\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p72sb\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-kube-api-access-p72sb\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373503 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-socket\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373503 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-data\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373503 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-certs\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-credential-socket\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.373809 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.373777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istiod-ca-cert\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.375620 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.375597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-envoy\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.375832 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.375811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-podinfo\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.389509 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.389486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-token\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.391186 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.391161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p72sb\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-kube-api-access-p72sb\") pod \"e2e-mt-006b1977-openshift-default-5bffc788-7vd5g\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") " pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.486776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.486748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:41.981458 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:48:41.981417    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db3099e_15f5_4a34_8735_c2c0dbb9e361.slice/crio-e4755cb7a5ad85d7a182988d9fd96da853c946460f7428f2be1d08e9403f017c WatchSource:0}: Error finding container e4755cb7a5ad85d7a182988d9fd96da853c946460f7428f2be1d08e9403f017c: Status 404 returned error can't find the container with id e4755cb7a5ad85d7a182988d9fd96da853c946460f7428f2be1d08e9403f017c
Sep 10 12:48:41.984659 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.984635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"]
Sep 10 12:48:41.984849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.984818    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:48:41.984887 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.984879    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:48:41.984926 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:41.984907    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:48:42.693435 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:42.693396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" event={"ID":"1db3099e-15f5-4a34-8735-c2c0dbb9e361","Type":"ContainerStarted","Data":"5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73"}
Sep 10 12:48:42.693841 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:42.693453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" event={"ID":"1db3099e-15f5-4a34-8735-c2c0dbb9e361","Type":"ContainerStarted","Data":"e4755cb7a5ad85d7a182988d9fd96da853c946460f7428f2be1d08e9403f017c"}
Sep 10 12:48:42.733455 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:42.733395    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" podStartSLOduration=1.733379625 podStartE2EDuration="1.733379625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:48:42.730295371 +0000 UTC m=+1113.850649961" watchObservedRunningTime="2026-09-10 12:48:42.733379625 +0000 UTC m=+1113.853734201"
Sep 10 12:48:43.487830 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:43.487790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:43.492859 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:43.492836    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:43.698533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:43.698504    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:43.699560 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:43.699544    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:48:48.585068 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:48.585038    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"]
Sep 10 12:48:48.585532 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:48.585266    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy" containerID="cri-o://f742c18a159e249c192a7ef5fbe3b7d22f357dfb2b702f113be56a1152977e00" gracePeriod=30
Sep 10 12:48:49.697958 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:49.697920    2565 patch_prober.go:28] interesting pod/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:48:49.698422 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:49.697994    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:48:50.307574 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.307541    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"]
Sep 10 12:48:50.311350 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.311319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.316051 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.316026    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-006b1977-serving-cert\""
Sep 10 12:48:50.329497 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.329467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"]
Sep 10 12:48:50.461045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.461007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.461045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.461049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9767fb-e3b8-4eae-9077-148527467b10-openshift-service-ca\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.461349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.461095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-metrics-certs\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.461349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.461168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4589b\" (UniqueName: \"kubernetes.io/projected/6a9767fb-e3b8-4eae-9077-148527467b10-kube-api-access-4589b\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.562349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.562256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.562349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.562311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9767fb-e3b8-4eae-9077-148527467b10-openshift-service-ca\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.562594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.562360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-metrics-certs\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.562594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.562391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4589b\" (UniqueName: \"kubernetes.io/projected/6a9767fb-e3b8-4eae-9077-148527467b10-kube-api-access-4589b\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.562594 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:48:50.562429    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-serving-cert: secret "maas-api-e2e-mt-006b1977-serving-cert" not found
Sep 10 12:48:50.562594 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:48:50.562502    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls podName:6a9767fb-e3b8-4eae-9077-148527467b10 nodeName:}" failed. No retries permitted until 2026-09-10 12:48:51.062481354 +0000 UTC m=+1122.182835922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls") pod "maas-api-e2e-mt-006b1977-968c5bf94-g4j5c" (UID: "6a9767fb-e3b8-4eae-9077-148527467b10") : secret "maas-api-e2e-mt-006b1977-serving-cert" not found
Sep 10 12:48:50.563025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.563007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9767fb-e3b8-4eae-9077-148527467b10-openshift-service-ca\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.564954 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.564931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-metrics-certs\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:50.586644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:50.586611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4589b\" (UniqueName: \"kubernetes.io/projected/6a9767fb-e3b8-4eae-9077-148527467b10-kube-api-access-4589b\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:51.067264 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:51.067219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:51.069773 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:51.069750    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls\") pod \"maas-api-e2e-mt-006b1977-968c5bf94-g4j5c\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:51.222740 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:51.222704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:51.511949 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:51.511923    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"]
Sep 10 12:48:51.513844 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:48:51.513814    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9767fb_e3b8_4eae_9077_148527467b10.slice/crio-7df687c3373874aec677732903a070ae0d3c3b02e5d1b8848bb3afde8a8d2076 WatchSource:0}: Error finding container 7df687c3373874aec677732903a070ae0d3c3b02e5d1b8848bb3afde8a8d2076: Status 404 returned error can't find the container with id 7df687c3373874aec677732903a070ae0d3c3b02e5d1b8848bb3afde8a8d2076
Sep 10 12:48:51.741774 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:51.741740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c" event={"ID":"6a9767fb-e3b8-4eae-9077-148527467b10","Type":"ContainerStarted","Data":"7df687c3373874aec677732903a070ae0d3c3b02e5d1b8848bb3afde8a8d2076"}
Sep 10 12:48:52.749388 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:52.749356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c" event={"ID":"6a9767fb-e3b8-4eae-9077-148527467b10","Type":"ContainerStarted","Data":"255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84"}
Sep 10 12:48:52.749759 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:52.749419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:48:52.777495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:52.777442    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c" podStartSLOduration=2.371524125 podStartE2EDuration="2.777424527s" totalImagesPullingTime="405.900402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:48:52.775823696 +0000 UTC m=+1123.896178274" watchObservedRunningTime="2026-09-10 12:48:52.777424527 +0000 UTC m=+1123.897779112"
Sep 10 12:48:53.759665 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.759618    2565 generic.go:356] "Generic (PLEG): container finished" podID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerID="f742c18a159e249c192a7ef5fbe3b7d22f357dfb2b702f113be56a1152977e00" exitCode=0
Sep 10 12:48:53.760099 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.760066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" event={"ID":"05c8a4c7-2f4a-412b-9d1e-6da6614652fd","Type":"ContainerDied","Data":"f742c18a159e249c192a7ef5fbe3b7d22f357dfb2b702f113be56a1152977e00"}
Sep 10 12:48:53.760202 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.760165    2565 scope.go:117] "RemoveContainer" containerID="7136d402963a1a6f9db98c629b4d82e49d89b143cb176070571ec07c5f979ad1"
Sep 10 12:48:53.850717 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.850655    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:48:53.996648 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996615    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-token\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.996648 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996653    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-envoy\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.996870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996694    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-certs\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.996870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-credential-socket\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.996870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996829    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-socket\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.996870 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996862    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-data\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.997077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996904    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-podinfo\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.997077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.996940    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c5dt\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-kube-api-access-5c5dt\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.997077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:48:53.997077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997028    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:48:53.997324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istiod-ca-cert\") pod \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\" (UID: \"05c8a4c7-2f4a-412b-9d1e-6da6614652fd\") "
Sep 10 12:48:53.997324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997115    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:48:53.997324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997161    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:48:53.997698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997500    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:48:53.997698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997514    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:53.997698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997537    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:53.997698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997625    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:53.997950 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.997725    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:53.999050 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.999023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:48:53.999160 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.999099    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-kube-api-access-5c5dt" (OuterVolumeSpecName: "kube-api-access-5c5dt") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "kube-api-access-5c5dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:48:53.999311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.999174    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:48:53.999311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:53.999257    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05c8a4c7-2f4a-412b-9d1e-6da6614652fd" (UID: "05c8a4c7-2f4a-412b-9d1e-6da6614652fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:48:54.098871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.098834    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:54.098871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.098864    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:54.098871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.098872    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:54.098871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.098879    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:54.099141 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.098888    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c5dt\" (UniqueName: \"kubernetes.io/projected/05c8a4c7-2f4a-412b-9d1e-6da6614652fd-kube-api-access-5c5dt\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:48:54.766502 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.766475    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"
Sep 10 12:48:54.766502 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.766495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l" event={"ID":"05c8a4c7-2f4a-412b-9d1e-6da6614652fd","Type":"ContainerDied","Data":"5d20a9c578c730c10ceac1d429944d12493b6a897fe2320d841c95aa1c24c7ee"}
Sep 10 12:48:54.767026 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.766549    2565 scope.go:117] "RemoveContainer" containerID="f742c18a159e249c192a7ef5fbe3b7d22f357dfb2b702f113be56a1152977e00"
Sep 10 12:48:54.799595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.799566    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"]
Sep 10 12:48:54.805644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:54.805620    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-2d4635-openshift-default-547888c8d8-n8w6l"]
Sep 10 12:48:55.394880 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:55.394845    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" path="/var/lib/kubelet/pods/05c8a4c7-2f4a-412b-9d1e-6da6614652fd/volumes"
Sep 10 12:48:58.765897 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:48:58.765871    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:49:01.735833 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.735798    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"]
Sep 10 12:49:01.736198 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.736152    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy"
Sep 10 12:49:01.736198 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.736162    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy"
Sep 10 12:49:01.736320 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.736255    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy"
Sep 10 12:49:01.736320 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.736264    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy"
Sep 10 12:49:01.740407 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.740386    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.747488 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.747457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-30919a\"/\"default-dockercfg-8xhp5\""
Sep 10 12:49:01.747488 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.747454    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-30919a\"/\"distinct-w0-30919a-kserve-self-signed-certs\""
Sep 10 12:49:01.747658 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.747461    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-30919a\"/\"openshift-service-ca.crt\""
Sep 10 12:49:01.747658 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.747504    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-30919a\"/\"kube-root-ca.crt\""
Sep 10 12:49:01.760404 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.760371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"]
Sep 10 12:49:01.767353 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.767316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-dshm\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.767515 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.767406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-model-cache\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.767515 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.767432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tmp-dir\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.767515 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.767454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnk5n\" (UniqueName: \"kubernetes.io/projected/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-kube-api-access-tnk5n\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.767515 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.767493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-home\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.767810 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.767520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tls-certs\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-model-cache\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tmp-dir\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnk5n\" (UniqueName: \"kubernetes.io/projected/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-kube-api-access-tnk5n\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-home\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tls-certs\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-dshm\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868710    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-model-cache\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tmp-dir\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.868817 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.868782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-home\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.870806 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.870780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-dshm\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.871132 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.871112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tls-certs\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:01.884690 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:01.884661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnk5n\" (UniqueName: \"kubernetes.io/projected/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-kube-api-access-tnk5n\") pod \"distinct-w0-30919a-kserve-74f59cc45b-hxtw5\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") " pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:02.049420 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:02.049322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:02.348188 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:02.348159    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"]
Sep 10 12:49:02.349164 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:49:02.349138    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0eddc2c_93b7_4673_a769_fb3b5544e2cc.slice/crio-5c491d17cc7fc5956c78182af68d072275da04d82537179d409db212e70411d7 WatchSource:0}: Error finding container 5c491d17cc7fc5956c78182af68d072275da04d82537179d409db212e70411d7: Status 404 returned error can't find the container with id 5c491d17cc7fc5956c78182af68d072275da04d82537179d409db212e70411d7
Sep 10 12:49:02.811680 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:02.811640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5" event={"ID":"f0eddc2c-93b7-4673-a769-fb3b5544e2cc","Type":"ContainerStarted","Data":"5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4"}
Sep 10 12:49:02.812073 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:02.811691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5" event={"ID":"f0eddc2c-93b7-4673-a769-fb3b5544e2cc","Type":"ContainerStarted","Data":"5c491d17cc7fc5956c78182af68d072275da04d82537179d409db212e70411d7"}
Sep 10 12:49:02.844358 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:02.844311    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5" podStartSLOduration=1.84429434 podStartE2EDuration="1.84429434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:02.842538452 +0000 UTC m=+1133.962893030" watchObservedRunningTime="2026-09-10 12:49:02.84429434 +0000 UTC m=+1133.964648913"
Sep 10 12:49:12.049840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:12.049798    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:12.050313 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:12.050066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:12.062879 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:12.062859    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:12.875364 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:12.875329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:49:21.919403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:21.919302    2565 generic.go:356] "Generic (PLEG): container finished" podID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerID="5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73" exitCode=0
Sep 10 12:49:21.919403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:21.919379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" event={"ID":"1db3099e-15f5-4a34-8735-c2c0dbb9e361","Type":"ContainerDied","Data":"5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73"}
Sep 10 12:49:21.919843 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:21.919824    2565 scope.go:117] "RemoveContainer" containerID="5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73"
Sep 10 12:49:21.920916 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:21.920888    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:49:21.920977 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:21.920962    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:49:21.921012 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:21.920996    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:49:22.926400 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:22.926367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" event={"ID":"1db3099e-15f5-4a34-8735-c2c0dbb9e361","Type":"ContainerStarted","Data":"4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106"}
Sep 10 12:49:23.487468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:23.487435    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:49:23.487769 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:23.487688    2565 patch_prober.go:28] interesting pod/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 12:49:23.487926 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:23.487900    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 12:49:24.488192 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:24.488151    2565 patch_prober.go:28] interesting pod/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 12:49:24.488696 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:24.488289    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 12:49:25.487829 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:25.487789    2565 patch_prober.go:28] interesting pod/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 12:49:25.488045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:25.487853    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 12:49:26.487953 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:26.487916    2565 patch_prober.go:28] interesting pod/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 12:49:26.488546 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:26.488511    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 12:49:27.487635 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:27.487592    2565 patch_prober.go:28] interesting pod/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 12:49:27.487895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:27.487656    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 12:49:28.491601 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:28.491572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:49:28.491965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:28.491852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:49:28.492632 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:28.492612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:49:33.432529 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.432453    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"]
Sep 10 12:49:33.432890 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.432646    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c" podUID="6a9767fb-e3b8-4eae-9077-148527467b10" containerName="maas-api" containerID="cri-o://255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84" gracePeriod=30
Sep 10 12:49:33.680264 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.680234    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:49:33.786508 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.786476    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4589b\" (UniqueName: \"kubernetes.io/projected/6a9767fb-e3b8-4eae-9077-148527467b10-kube-api-access-4589b\") pod \"6a9767fb-e3b8-4eae-9077-148527467b10\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") "
Sep 10 12:49:33.786508 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.786514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-metrics-certs\") pod \"6a9767fb-e3b8-4eae-9077-148527467b10\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") "
Sep 10 12:49:33.786761 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.786559    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls\") pod \"6a9767fb-e3b8-4eae-9077-148527467b10\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") "
Sep 10 12:49:33.786761 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.786595    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9767fb-e3b8-4eae-9077-148527467b10-openshift-service-ca\") pod \"6a9767fb-e3b8-4eae-9077-148527467b10\" (UID: \"6a9767fb-e3b8-4eae-9077-148527467b10\") "
Sep 10 12:49:33.787081 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.787053    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a9767fb-e3b8-4eae-9077-148527467b10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a9767fb-e3b8-4eae-9077-148527467b10" (UID: "6a9767fb-e3b8-4eae-9077-148527467b10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:49:33.788742 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.788722    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6a9767fb-e3b8-4eae-9077-148527467b10" (UID: "6a9767fb-e3b8-4eae-9077-148527467b10"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:49:33.788816 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.788764    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a9767fb-e3b8-4eae-9077-148527467b10" (UID: "6a9767fb-e3b8-4eae-9077-148527467b10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:49:33.788865 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.788844    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9767fb-e3b8-4eae-9077-148527467b10-kube-api-access-4589b" (OuterVolumeSpecName: "kube-api-access-4589b") pod "6a9767fb-e3b8-4eae-9077-148527467b10" (UID: "6a9767fb-e3b8-4eae-9077-148527467b10"). InnerVolumeSpecName "kube-api-access-4589b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:49:33.887705 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.887670    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9767fb-e3b8-4eae-9077-148527467b10-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:33.887975 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.887953    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4589b\" (UniqueName: \"kubernetes.io/projected/6a9767fb-e3b8-4eae-9077-148527467b10-kube-api-access-4589b\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:33.888139 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.888110    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:33.888139 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.888135    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a9767fb-e3b8-4eae-9077-148527467b10-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:33.987261 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.987224    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a9767fb-e3b8-4eae-9077-148527467b10" containerID="255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84" exitCode=0
Sep 10 12:49:33.987463 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.987293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c" event={"ID":"6a9767fb-e3b8-4eae-9077-148527467b10","Type":"ContainerDied","Data":"255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84"}
Sep 10 12:49:33.987463 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.987332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c" event={"ID":"6a9767fb-e3b8-4eae-9077-148527467b10","Type":"ContainerDied","Data":"7df687c3373874aec677732903a070ae0d3c3b02e5d1b8848bb3afde8a8d2076"}
Sep 10 12:49:33.987463 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.987362    2565 scope.go:117] "RemoveContainer" containerID="255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84"
Sep 10 12:49:33.987463 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.987293    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"
Sep 10 12:49:33.998337 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.998246    2565 scope.go:117] "RemoveContainer" containerID="255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84"
Sep 10 12:49:33.998646 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:49:33.998628    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84\": container with ID starting with 255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84 not found: ID does not exist" containerID="255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84"
Sep 10 12:49:33.998736 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:33.998658    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84"} err="failed to get container status \"255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84\": rpc error: code = NotFound desc = could not find container \"255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84\": container with ID starting with 255a8b081da7702243eb10a0b997a39b5f28b3f85d8fd6a348d7f46830b14a84 not found: ID does not exist"
Sep 10 12:49:34.019633 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:34.019568    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"]
Sep 10 12:49:34.023478 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:34.023453    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-006b1977-968c5bf94-g4j5c"]
Sep 10 12:49:35.396175 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:35.396142    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a9767fb-e3b8-4eae-9077-148527467b10" path="/var/lib/kubelet/pods/6a9767fb-e3b8-4eae-9077-148527467b10/volumes"
Sep 10 12:49:43.578502 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:43.578466    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"]
Sep 10 12:49:43.579084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:43.578707    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy" containerID="cri-o://4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106" gracePeriod=30
Sep 10 12:49:48.842128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.842101    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:49:48.920098 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920009    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-socket\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920098 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istiod-ca-cert\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920098 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p72sb\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-kube-api-access-p72sb\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-envoy\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920153    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-podinfo\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920182    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-certs\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920250    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-token\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-data\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-credential-socket\") pod \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\" (UID: \"1db3099e-15f5-4a34-8735-c2c0dbb9e361\") "
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920561    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920653    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920665    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920673    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920668    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:49:48.920714 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.920701    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-data" (OuterVolumeSpecName: "istio-data") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:49:48.922643 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.922614    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:49:48.922771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.922666    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:49:48.922857 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.922840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-kube-api-access-p72sb" (OuterVolumeSpecName: "kube-api-access-p72sb") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "kube-api-access-p72sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:49:48.922921 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:48.922887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-token" (OuterVolumeSpecName: "istio-token") pod "1db3099e-15f5-4a34-8735-c2c0dbb9e361" (UID: "1db3099e-15f5-4a34-8735-c2c0dbb9e361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:49:49.021595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.021560    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:49.021595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.021602    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:49.021811 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.021617    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:49.021811 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.021631    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p72sb\" (UniqueName: \"kubernetes.io/projected/1db3099e-15f5-4a34-8735-c2c0dbb9e361-kube-api-access-p72sb\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:49.021811 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.021643    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:49.021811 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.021656    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db3099e-15f5-4a34-8735-c2c0dbb9e361-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:49:49.066965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.066930    2565 generic.go:356] "Generic (PLEG): container finished" podID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerID="4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106" exitCode=0
Sep 10 12:49:49.067133 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.066980    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"
Sep 10 12:49:49.067133 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.067014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" event={"ID":"1db3099e-15f5-4a34-8735-c2c0dbb9e361","Type":"ContainerDied","Data":"4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106"}
Sep 10 12:49:49.067133 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.067072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g" event={"ID":"1db3099e-15f5-4a34-8735-c2c0dbb9e361","Type":"ContainerDied","Data":"e4755cb7a5ad85d7a182988d9fd96da853c946460f7428f2be1d08e9403f017c"}
Sep 10 12:49:49.067133 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.067094    2565 scope.go:117] "RemoveContainer" containerID="4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106"
Sep 10 12:49:49.077270 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.077247    2565 scope.go:117] "RemoveContainer" containerID="5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73"
Sep 10 12:49:49.085504 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.085485    2565 scope.go:117] "RemoveContainer" containerID="4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106"
Sep 10 12:49:49.085791 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:49:49.085770    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106\": container with ID starting with 4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106 not found: ID does not exist" containerID="4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106"
Sep 10 12:49:49.085849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.085801    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106"} err="failed to get container status \"4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106\": rpc error: code = NotFound desc = could not find container \"4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106\": container with ID starting with 4421e0ddbdd3c2cc6038b1a4feacbc73cc5b4d14a79895cbab067de792a1d106 not found: ID does not exist"
Sep 10 12:49:49.085849 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.085819    2565 scope.go:117] "RemoveContainer" containerID="5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73"
Sep 10 12:49:49.086047 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:49:49.086032    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73\": container with ID starting with 5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73 not found: ID does not exist" containerID="5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73"
Sep 10 12:49:49.086106 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.086051    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73"} err="failed to get container status \"5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73\": rpc error: code = NotFound desc = could not find container \"5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73\": container with ID starting with 5f673976ec7a12b716c6a484fe19125feeb81fd12f772cb6abd991e504d77f73 not found: ID does not exist"
Sep 10 12:49:49.101262 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.101234    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"]
Sep 10 12:49:49.110524 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.110498    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-006b1977-openshift-default-5bffc788-7vd5g"]
Sep 10 12:49:49.395233 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:49.395189    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" path="/var/lib/kubelet/pods/1db3099e-15f5-4a34-8735-c2c0dbb9e361/volumes"
Sep 10 12:49:53.354353 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354320    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"]
Sep 10 12:49:53.354705 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354693    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy"
Sep 10 12:49:53.354764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354708    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c8a4c7-2f4a-412b-9d1e-6da6614652fd" containerName="istio-proxy"
Sep 10 12:49:53.354764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354715    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy"
Sep 10 12:49:53.354764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354721    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy"
Sep 10 12:49:53.354764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354733    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy"
Sep 10 12:49:53.354764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354739    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy"
Sep 10 12:49:53.354764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354750    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9767fb-e3b8-4eae-9077-148527467b10" containerName="maas-api"
Sep 10 12:49:53.354764 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354756    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9767fb-e3b8-4eae-9077-148527467b10" containerName="maas-api"
Sep 10 12:49:53.354989 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354821    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy"
Sep 10 12:49:53.354989 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.354830    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9767fb-e3b8-4eae-9077-148527467b10" containerName="maas-api"
Sep 10 12:49:53.359364 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.359340    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.362799 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.362773    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-340098\"/\"noten-model-340098-kserve-self-signed-certs\""
Sep 10 12:49:53.363814 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.363795    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-340098\"/\"kube-root-ca.crt\""
Sep 10 12:49:53.363930 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.363815    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-340098\"/\"openshift-service-ca.crt\""
Sep 10 12:49:53.364006 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.363943    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-340098\"/\"default-dockercfg-n8srb\""
Sep 10 12:49:53.399653 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.399618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"]
Sep 10 12:49:53.457483 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.457453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-tmp-dir\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.457644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.457494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnttx\" (UniqueName: \"kubernetes.io/projected/e91892db-f096-4c84-be0a-6f0a74c855ca-kube-api-access-vnttx\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.457644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.457514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-dshm\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.457644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.457584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-model-cache\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.457644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.457615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91892db-f096-4c84-be0a-6f0a74c855ca-tls-certs\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.457644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.457639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-home\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.558877 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.558846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91892db-f096-4c84-be0a-6f0a74c855ca-tls-certs\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.558883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-home\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.558932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-tmp-dir\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.558974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnttx\" (UniqueName: \"kubernetes.io/projected/e91892db-f096-4c84-be0a-6f0a74c855ca-kube-api-access-vnttx\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559059 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.559000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-dshm\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559310 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.559061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-model-cache\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559415 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.559393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-home\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559511 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.559485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-model-cache\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.559638 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.559554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-tmp-dir\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.561378 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.561356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-dshm\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.561678 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.561659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91892db-f096-4c84-be0a-6f0a74c855ca-tls-certs\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.580724 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.580698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnttx\" (UniqueName: \"kubernetes.io/projected/e91892db-f096-4c84-be0a-6f0a74c855ca-kube-api-access-vnttx\") pod \"noten-model-340098-kserve-5cb9c7585f-8mjr5\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") " pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:53.668637 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:53.668564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:49:54.020464 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:54.020434    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"]
Sep 10 12:49:54.021580 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:49:54.021553    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode91892db_f096_4c84_be0a_6f0a74c855ca.slice/crio-2dc363195064e39b6adbec7b14d087fcad85bbb94f51aec0985ff6310484b5b1 WatchSource:0}: Error finding container 2dc363195064e39b6adbec7b14d087fcad85bbb94f51aec0985ff6310484b5b1: Status 404 returned error can't find the container with id 2dc363195064e39b6adbec7b14d087fcad85bbb94f51aec0985ff6310484b5b1
Sep 10 12:49:54.097631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:54.097594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5" event={"ID":"e91892db-f096-4c84-be0a-6f0a74c855ca","Type":"ContainerStarted","Data":"ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622"}
Sep 10 12:49:54.097763 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:54.097645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5" event={"ID":"e91892db-f096-4c84-be0a-6f0a74c855ca","Type":"ContainerStarted","Data":"2dc363195064e39b6adbec7b14d087fcad85bbb94f51aec0985ff6310484b5b1"}
Sep 10 12:49:54.151315 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:49:54.151248    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5" podStartSLOduration=1.151193564 podStartE2EDuration="1.151193564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:54.150122789 +0000 UTC m=+1185.270477367" watchObservedRunningTime="2026-09-10 12:49:54.151193564 +0000 UTC m=+1185.271548141"
Sep 10 12:50:01.799604 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.799571    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"]
Sep 10 12:50:01.800166 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.800147    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db3099e-15f5-4a34-8735-c2c0dbb9e361" containerName="istio-proxy"
Sep 10 12:50:01.803347 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.803327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.814781 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.814760    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-ac8db6-openshift-default-dockercfg-24pxt\""
Sep 10 12:50:01.830970 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.830940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"]
Sep 10 12:50:01.939698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.939658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f25376f6-8a68-4283-ab23-abd8eda32e82-istiod-ca-cert\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.939914 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.939732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-certs\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.939914 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.939784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-podinfo\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.939914 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.939827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-token\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.940045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.939919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-data\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.940045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.939959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-socket\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.940045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.939974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-credential-socket\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.940045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.940018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdhf\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-kube-api-access-qtdhf\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:01.940045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:01.940039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-envoy\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041190 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-data\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041190 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-socket\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-credential-socket\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdhf\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-kube-api-access-qtdhf\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-envoy\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f25376f6-8a68-4283-ab23-abd8eda32e82-istiod-ca-cert\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-certs\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-podinfo\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041762 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-token\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041762 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-data\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041864 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-certs\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.041996 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.041980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-credential-socket\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.042051 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.042029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f25376f6-8a68-4283-ab23-abd8eda32e82-istiod-ca-cert\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.042051 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.042030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-socket\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.043882 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.043858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-envoy\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.044270 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.044249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-podinfo\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.055370 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.055317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdhf\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-kube-api-access-qtdhf\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.059507 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.059482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-token\") pod \"e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") " pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.113419 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.113381    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:02.413621 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:50:02.413585    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25376f6_8a68_4283_ab23_abd8eda32e82.slice/crio-3379276228dbe8884fbe04d4ed6ec796baf4b71aaaf6f9911e5f96714b793f81 WatchSource:0}: Error finding container 3379276228dbe8884fbe04d4ed6ec796baf4b71aaaf6f9911e5f96714b793f81: Status 404 returned error can't find the container with id 3379276228dbe8884fbe04d4ed6ec796baf4b71aaaf6f9911e5f96714b793f81
Sep 10 12:50:02.414380 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.414359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"]
Sep 10 12:50:02.417239 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.416459    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:50:02.417239 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.416606    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:50:02.417239 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:02.416692    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:50:03.149204 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:03.149162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" event={"ID":"f25376f6-8a68-4283-ab23-abd8eda32e82","Type":"ContainerStarted","Data":"8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3"}
Sep 10 12:50:03.149596 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:03.149287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" event={"ID":"f25376f6-8a68-4283-ab23-abd8eda32e82","Type":"ContainerStarted","Data":"3379276228dbe8884fbe04d4ed6ec796baf4b71aaaf6f9911e5f96714b793f81"}
Sep 10 12:50:03.177799 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:03.177742    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podStartSLOduration=2.177726399 podStartE2EDuration="2.177726399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:50:03.176161277 +0000 UTC m=+1194.296515884" watchObservedRunningTime="2026-09-10 12:50:03.177726399 +0000 UTC m=+1194.298080975"
Sep 10 12:50:03.668798 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:03.668687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:50:03.668980 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:03.668849    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:50:03.681529 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:03.681503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:50:04.113936 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:04.113898    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:04.118838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:04.118805    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:04.155267 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:04.155236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:04.156039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:04.156019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:04.166462 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:04.166443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:50:06.533592 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.533560    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"]
Sep 10 12:50:06.536875 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.536858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.544958 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.544934    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-ac8db6-serving-cert\""
Sep 10 12:50:06.557777 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.557745    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"]
Sep 10 12:50:06.684245 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.684178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.684451 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.684250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.684451 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.684329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qb7m\" (UniqueName: \"kubernetes.io/projected/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-kube-api-access-6qb7m\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.684451 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.684371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.784940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.784851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.784940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.784892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.784940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.784938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qb7m\" (UniqueName: \"kubernetes.io/projected/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-kube-api-access-6qb7m\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.785278 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.784967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.785728 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.785699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.787485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.787463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.787610 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.787516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.794966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.794944    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qb7m\" (UniqueName: \"kubernetes.io/projected/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-kube-api-access-6qb7m\") pod \"maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:06.848761 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:06.848728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:07.130406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:07.130377    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"]
Sep 10 12:50:07.131824 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:50:07.131791    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe25df0a_7dd9_4c53_a288_ffa6bc7f22d5.slice/crio-90fda70db727eabb37e114c8fbcfe5f4d107ef3cb632cc319c472bde69b8f476 WatchSource:0}: Error finding container 90fda70db727eabb37e114c8fbcfe5f4d107ef3cb632cc319c472bde69b8f476: Status 404 returned error can't find the container with id 90fda70db727eabb37e114c8fbcfe5f4d107ef3cb632cc319c472bde69b8f476
Sep 10 12:50:07.173622 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:07.173585    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq" event={"ID":"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5","Type":"ContainerStarted","Data":"90fda70db727eabb37e114c8fbcfe5f4d107ef3cb632cc319c472bde69b8f476"}
Sep 10 12:50:08.181458 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:08.181362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq" event={"ID":"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5","Type":"ContainerStarted","Data":"5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be"}
Sep 10 12:50:08.181458 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:08.181422    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:08.210256 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:08.210179    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq" podStartSLOduration=1.4364342030000001 podStartE2EDuration="2.210164406s" totalImagesPullingTime="773.730203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:50:08.208321165 +0000 UTC m=+1199.328675743" watchObservedRunningTime="2026-09-10 12:50:08.210164406 +0000 UTC m=+1199.330518982"
Sep 10 12:50:14.192553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:14.192524    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:50:30.105489 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:30.105437    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"]
Sep 10 12:50:34.884685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:34.883794    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:35466->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Sep 10 12:50:34.884685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:34.883869    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:35466->10.132.0.54:15021: read: connection reset by peer"
Sep 10 12:50:35.345023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.344988    2565 generic.go:356] "Generic (PLEG): container finished" podID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerID="8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3" exitCode=0
Sep 10 12:50:35.345189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.345052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" event={"ID":"f25376f6-8a68-4283-ab23-abd8eda32e82","Type":"ContainerDied","Data":"8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3"}
Sep 10 12:50:35.345572 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.345556    2565 scope.go:117] "RemoveContainer" containerID="8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3"
Sep 10 12:50:35.346679 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.346650    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:50:35.346732 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.346722    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:50:35.346771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.346754    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:50:35.431930 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.431895    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"]
Sep 10 12:50:35.436530 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.436502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.441202 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.441180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w1-719d8a-serving-cert\""
Sep 10 12:50:35.458382 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.458276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"]
Sep 10 12:50:35.468781 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.468750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/975fc832-c8b7-4947-922a-a2b99d963c10-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.469156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.468844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w2nr\" (UniqueName: \"kubernetes.io/projected/975fc832-c8b7-4947-922a-a2b99d963c10-kube-api-access-2w2nr\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.469156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.469045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.469156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.469127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.570009 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.569975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/975fc832-c8b7-4947-922a-a2b99d963c10-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.570009 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.570017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w2nr\" (UniqueName: \"kubernetes.io/projected/975fc832-c8b7-4947-922a-a2b99d963c10-kube-api-access-2w2nr\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.570308 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.570074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.570308 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.570103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.570731 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.570707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/975fc832-c8b7-4947-922a-a2b99d963c10-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.572671 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.572639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.572772 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.572680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.586423 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.586402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w2nr\" (UniqueName: \"kubernetes.io/projected/975fc832-c8b7-4947-922a-a2b99d963c10-kube-api-access-2w2nr\") pod \"maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:35.750909 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:35.750874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:36.038085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:36.038058    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"]
Sep 10 12:50:36.039090 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:50:36.039063    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975fc832_c8b7_4947_922a_a2b99d963c10.slice/crio-733ed8a6d5cd21539af8859f076355ad968da7ad17bfa7e4b72b814e2eaf18e9 WatchSource:0}: Error finding container 733ed8a6d5cd21539af8859f076355ad968da7ad17bfa7e4b72b814e2eaf18e9: Status 404 returned error can't find the container with id 733ed8a6d5cd21539af8859f076355ad968da7ad17bfa7e4b72b814e2eaf18e9
Sep 10 12:50:36.352462 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:36.352365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2" event={"ID":"975fc832-c8b7-4947-922a-a2b99d963c10","Type":"ContainerStarted","Data":"733ed8a6d5cd21539af8859f076355ad968da7ad17bfa7e4b72b814e2eaf18e9"}
Sep 10 12:50:36.354327 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:36.354303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" event={"ID":"f25376f6-8a68-4283-ab23-abd8eda32e82","Type":"ContainerStarted","Data":"db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990"}
Sep 10 12:50:36.740653 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:36.740623    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"]
Sep 10 12:50:36.740856 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:36.740835    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl" podUID="7560938b-7407-4940-b12b-072edf8670db" containerName="maas-api" containerID="cri-o://575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f" gracePeriod=30
Sep 10 12:50:37.042297 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.042266    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:50:37.094633 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.093544    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-metrics-certs\") pod \"7560938b-7407-4940-b12b-072edf8670db\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") "
Sep 10 12:50:37.094633 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.093593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls\") pod \"7560938b-7407-4940-b12b-072edf8670db\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") "
Sep 10 12:50:37.094633 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.093679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7560938b-7407-4940-b12b-072edf8670db-openshift-service-ca\") pod \"7560938b-7407-4940-b12b-072edf8670db\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") "
Sep 10 12:50:37.094633 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.093753    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mg94\" (UniqueName: \"kubernetes.io/projected/7560938b-7407-4940-b12b-072edf8670db-kube-api-access-9mg94\") pod \"7560938b-7407-4940-b12b-072edf8670db\" (UID: \"7560938b-7407-4940-b12b-072edf8670db\") "
Sep 10 12:50:37.099233 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.096178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7560938b-7407-4940-b12b-072edf8670db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7560938b-7407-4940-b12b-072edf8670db" (UID: "7560938b-7407-4940-b12b-072edf8670db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:50:37.128249 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.117561    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7560938b-7407-4940-b12b-072edf8670db" (UID: "7560938b-7407-4940-b12b-072edf8670db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:50:37.128249 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.117960    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:37.128249 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.118429    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:50:37.128249 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.118473    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7560938b-7407-4940-b12b-072edf8670db-kube-api-access-9mg94" (OuterVolumeSpecName: "kube-api-access-9mg94") pod "7560938b-7407-4940-b12b-072edf8670db" (UID: "7560938b-7407-4940-b12b-072edf8670db"). InnerVolumeSpecName "kube-api-access-9mg94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:50:37.128249 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.118478    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 12:50:37.139519 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.139471    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7560938b-7407-4940-b12b-072edf8670db" (UID: "7560938b-7407-4940-b12b-072edf8670db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:50:37.204238 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.200909    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:37.204238 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.200949    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7560938b-7407-4940-b12b-072edf8670db-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:37.204238 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.200964    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7560938b-7407-4940-b12b-072edf8670db-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:37.204238 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.200978    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mg94\" (UniqueName: \"kubernetes.io/projected/7560938b-7407-4940-b12b-072edf8670db-kube-api-access-9mg94\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:37.361357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.361262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2" event={"ID":"975fc832-c8b7-4947-922a-a2b99d963c10","Type":"ContainerStarted","Data":"048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31"}
Sep 10 12:50:37.361539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.361362    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:37.362787 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.362764    2565 generic.go:356] "Generic (PLEG): container finished" podID="7560938b-7407-4940-b12b-072edf8670db" containerID="575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f" exitCode=0
Sep 10 12:50:37.362915 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.362808    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"
Sep 10 12:50:37.362915 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.362844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl" event={"ID":"7560938b-7407-4940-b12b-072edf8670db","Type":"ContainerDied","Data":"575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f"}
Sep 10 12:50:37.362915 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.362889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl" event={"ID":"7560938b-7407-4940-b12b-072edf8670db","Type":"ContainerDied","Data":"f99a47f715b6d34d920219e9b390ea974ca6e397611ba3b09821a1a3d9282a3f"}
Sep 10 12:50:37.362915 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.362911    2565 scope.go:117] "RemoveContainer" containerID="575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f"
Sep 10 12:50:37.374536 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.373297    2565 scope.go:117] "RemoveContainer" containerID="575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f"
Sep 10 12:50:37.374536 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:50:37.373750    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f\": container with ID starting with 575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f not found: ID does not exist" containerID="575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f"
Sep 10 12:50:37.374536 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.373784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f"} err="failed to get container status \"575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f\": rpc error: code = NotFound desc = could not find container \"575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f\": container with ID starting with 575dd479d7dc697bf3bd289c08d4266f183155f2b1a48220efe533f48a4ac59f not found: ID does not exist"
Sep 10 12:50:37.398236 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.397596    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2" podStartSLOduration=2.052412077 podStartE2EDuration="2.397571052s" totalImagesPullingTime="345.158975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:50:37.396706806 +0000 UTC m=+1228.517061385" watchObservedRunningTime="2026-09-10 12:50:37.397571052 +0000 UTC m=+1228.517925633"
Sep 10 12:50:37.416802 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.416758    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"]
Sep 10 12:50:37.419046 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:37.419026    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f85889-554d6559fd-ds4bl"]
Sep 10 12:50:38.114578 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:38.114550    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:50:38.114978 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:38.114610    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 12:50:39.114432 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:39.114399    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:50:39.114623 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:39.114454    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 12:50:39.410019 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:39.409922    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7560938b-7407-4940-b12b-072edf8670db" path="/var/lib/kubelet/pods/7560938b-7407-4940-b12b-072edf8670db/volumes"
Sep 10 12:50:40.114431 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:40.114394    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:50:40.114618 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:40.114456    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 12:50:41.114147 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:41.114113    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:50:41.114739 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:41.114703    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 12:50:42.114482 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:42.114449    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:50:42.114883 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:42.114502    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 12:50:43.117882 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:43.117851    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:43.118336 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:43.118133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:43.118798 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:43.118781    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:50:43.373716 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:43.373638    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:50:45.127009 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.126973    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5" podUID="e91892db-f096-4c84-be0a-6f0a74c855ca" containerName="main" containerID="cri-o://ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622" gracePeriod=45
Sep 10 12:50:45.294813 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.294782    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"]
Sep 10 12:50:45.295049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.295023    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy" containerID="cri-o://d4764f2124821552550cd4c80606cfef0d5e200de6630f9fb7a095b63a3cdea5" gracePeriod=30
Sep 10 12:50:45.380963 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.380888    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:50:45.415235 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.414825    2565 generic.go:356] "Generic (PLEG): container finished" podID="e91892db-f096-4c84-be0a-6f0a74c855ca" containerID="ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622" exitCode=0
Sep 10 12:50:45.415235 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.414990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5" event={"ID":"e91892db-f096-4c84-be0a-6f0a74c855ca","Type":"ContainerDied","Data":"ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622"}
Sep 10 12:50:45.415235 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.415027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5" event={"ID":"e91892db-f096-4c84-be0a-6f0a74c855ca","Type":"ContainerDied","Data":"2dc363195064e39b6adbec7b14d087fcad85bbb94f51aec0985ff6310484b5b1"}
Sep 10 12:50:45.415235 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.415050    2565 scope.go:117] "RemoveContainer" containerID="ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622"
Sep 10 12:50:45.415235 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.415192    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"
Sep 10 12:50:45.429345 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.429319    2565 scope.go:117] "RemoveContainer" containerID="ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622"
Sep 10 12:50:45.429712 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:50:45.429692    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622\": container with ID starting with ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622 not found: ID does not exist" containerID="ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622"
Sep 10 12:50:45.429784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.429723    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622"} err="failed to get container status \"ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622\": rpc error: code = NotFound desc = could not find container \"ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622\": container with ID starting with ac83c1ff9b4158ee375ca226a1cb5245b661e0282a7a451b17e2e81122544622 not found: ID does not exist"
Sep 10 12:50:45.489409 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnttx\" (UniqueName: \"kubernetes.io/projected/e91892db-f096-4c84-be0a-6f0a74c855ca-kube-api-access-vnttx\") pod \"e91892db-f096-4c84-be0a-6f0a74c855ca\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") "
Sep 10 12:50:45.489571 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-home\") pod \"e91892db-f096-4c84-be0a-6f0a74c855ca\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") "
Sep 10 12:50:45.489571 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-dshm\") pod \"e91892db-f096-4c84-be0a-6f0a74c855ca\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") "
Sep 10 12:50:45.489685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91892db-f096-4c84-be0a-6f0a74c855ca-tls-certs\") pod \"e91892db-f096-4c84-be0a-6f0a74c855ca\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") "
Sep 10 12:50:45.489685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-tmp-dir\") pod \"e91892db-f096-4c84-be0a-6f0a74c855ca\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") "
Sep 10 12:50:45.489685 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489655    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-model-cache\") pod \"e91892db-f096-4c84-be0a-6f0a74c855ca\" (UID: \"e91892db-f096-4c84-be0a-6f0a74c855ca\") "
Sep 10 12:50:45.489830 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-home" (OuterVolumeSpecName: "home") pod "e91892db-f096-4c84-be0a-6f0a74c855ca" (UID: "e91892db-f096-4c84-be0a-6f0a74c855ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:45.489957 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e91892db-f096-4c84-be0a-6f0a74c855ca" (UID: "e91892db-f096-4c84-be0a-6f0a74c855ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:45.490011 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489968    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-home\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:45.490011 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.489986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "e91892db-f096-4c84-be0a-6f0a74c855ca" (UID: "e91892db-f096-4c84-be0a-6f0a74c855ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:45.491841 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.491813    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-dshm" (OuterVolumeSpecName: "dshm") pod "e91892db-f096-4c84-be0a-6f0a74c855ca" (UID: "e91892db-f096-4c84-be0a-6f0a74c855ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:45.491841 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.491819    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e91892db-f096-4c84-be0a-6f0a74c855ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e91892db-f096-4c84-be0a-6f0a74c855ca" (UID: "e91892db-f096-4c84-be0a-6f0a74c855ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:50:45.491995 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.491875    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91892db-f096-4c84-be0a-6f0a74c855ca-kube-api-access-vnttx" (OuterVolumeSpecName: "kube-api-access-vnttx") pod "e91892db-f096-4c84-be0a-6f0a74c855ca" (UID: "e91892db-f096-4c84-be0a-6f0a74c855ca"). InnerVolumeSpecName "kube-api-access-vnttx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:50:45.591473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.591439    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-dshm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:45.591473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.591468    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91892db-f096-4c84-be0a-6f0a74c855ca-tls-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:45.591473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.591479    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-tmp-dir\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:45.591697 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.591490    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91892db-f096-4c84-be0a-6f0a74c855ca-model-cache\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:45.591697 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.591501    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnttx\" (UniqueName: \"kubernetes.io/projected/e91892db-f096-4c84-be0a-6f0a74c855ca-kube-api-access-vnttx\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:45.762196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.762163    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"]
Sep 10 12:50:45.778223 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:45.778188    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-340098/noten-model-340098-kserve-5cb9c7585f-8mjr5"]
Sep 10 12:50:47.395418 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:47.395387    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91892db-f096-4c84-be0a-6f0a74c855ca" path="/var/lib/kubelet/pods/e91892db-f096-4c84-be0a-6f0a74c855ca/volumes"
Sep 10 12:50:50.445202 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.445168    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerID="d4764f2124821552550cd4c80606cfef0d5e200de6630f9fb7a095b63a3cdea5" exitCode=0
Sep 10 12:50:50.445600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.445262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" event={"ID":"4c681bc0-4a39-40f1-aa97-93914bb411dd","Type":"ContainerDied","Data":"d4764f2124821552550cd4c80606cfef0d5e200de6630f9fb7a095b63a3cdea5"}
Sep 10 12:50:50.445600 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.445341    2565 scope.go:117] "RemoveContainer" containerID="dbc63e1d96f16f26a4124757c3fee0eb204ea5686049470a545b12229b8e92a8"
Sep 10 12:50:50.541865 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.541842    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:50:50.640617 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640542    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-credential-socket\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.640617 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c681bc0-4a39-40f1-aa97-93914bb411dd-istiod-ca-cert\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.640617 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p95tk\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-kube-api-access-p95tk\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.640843 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640631    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-certs\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.640843 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-envoy\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.640843 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-token\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.640843 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-socket\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.641054 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:50.641054 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.640967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c681bc0-4a39-40f1-aa97-93914bb411dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:50:50.641054 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641007    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-data\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.641054 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641035    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:50.641311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:50.641311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641123    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-podinfo\") pod \"4c681bc0-4a39-40f1-aa97-93914bb411dd\" (UID: \"4c681bc0-4a39-40f1-aa97-93914bb411dd\") "
Sep 10 12:50:50.641311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641300    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:50.641553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641528    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.641553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641555    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c681bc0-4a39-40f1-aa97-93914bb411dd-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.641909 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641568    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.641909 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641578    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.641909 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.641591    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.643305 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.643281    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:50:50.643430 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.643307    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:50:50.643498 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.643476    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:50:50.643498 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.643489    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-kube-api-access-p95tk" (OuterVolumeSpecName: "kube-api-access-p95tk") pod "4c681bc0-4a39-40f1-aa97-93914bb411dd" (UID: "4c681bc0-4a39-40f1-aa97-93914bb411dd"). InnerVolumeSpecName "kube-api-access-p95tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:50:50.742392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.742345    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.742392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.742388    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p95tk\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-kube-api-access-p95tk\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.742392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.742400    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:50.742392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:50.742408    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c681bc0-4a39-40f1-aa97-93914bb411dd-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:51.452890 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:51.452861    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"
Sep 10 12:50:51.453324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:51.452863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz" event={"ID":"4c681bc0-4a39-40f1-aa97-93914bb411dd","Type":"ContainerDied","Data":"483fa55a536f2bc1079343b3a702ff7d7fcba0a288368c87abc3ec3ba99eaefe"}
Sep 10 12:50:51.453324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:51.452992    2565 scope.go:117] "RemoveContainer" containerID="d4764f2124821552550cd4c80606cfef0d5e200de6630f9fb7a095b63a3cdea5"
Sep 10 12:50:51.485444 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:51.485411    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"]
Sep 10 12:50:51.489083 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:51.489059    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f85889-openshift-default-796cf9975d-wlxgz"]
Sep 10 12:50:53.394641 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:53.394610    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" path="/var/lib/kubelet/pods/4c681bc0-4a39-40f1-aa97-93914bb411dd/volumes"
Sep 10 12:50:57.844900 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:57.844866    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"]
Sep 10 12:50:57.845673 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:57.845619    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq" podUID="c94ba23e-6460-4d23-aaf8-2e526d1f3678" containerName="maas-api" containerID="cri-o://b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6" gracePeriod=30
Sep 10 12:50:58.107284 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.107193    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:50:58.212908 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.212872    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls\") pod \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") "
Sep 10 12:50:58.213070 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.212967    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94ba23e-6460-4d23-aaf8-2e526d1f3678-openshift-service-ca\") pod \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") "
Sep 10 12:50:58.213070 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.212999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc5w4\" (UniqueName: \"kubernetes.io/projected/c94ba23e-6460-4d23-aaf8-2e526d1f3678-kube-api-access-xc5w4\") pod \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") "
Sep 10 12:50:58.213070 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.213021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-metrics-certs\") pod \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\" (UID: \"c94ba23e-6460-4d23-aaf8-2e526d1f3678\") "
Sep 10 12:50:58.213332 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.213299    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94ba23e-6460-4d23-aaf8-2e526d1f3678-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c94ba23e-6460-4d23-aaf8-2e526d1f3678" (UID: "c94ba23e-6460-4d23-aaf8-2e526d1f3678"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:50:58.213473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.213404    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c94ba23e-6460-4d23-aaf8-2e526d1f3678-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:58.215241 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.215194    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c94ba23e-6460-4d23-aaf8-2e526d1f3678" (UID: "c94ba23e-6460-4d23-aaf8-2e526d1f3678"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:50:58.215241 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.215204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c94ba23e-6460-4d23-aaf8-2e526d1f3678" (UID: "c94ba23e-6460-4d23-aaf8-2e526d1f3678"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:50:58.215407 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.215370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c94ba23e-6460-4d23-aaf8-2e526d1f3678-kube-api-access-xc5w4" (OuterVolumeSpecName: "kube-api-access-xc5w4") pod "c94ba23e-6460-4d23-aaf8-2e526d1f3678" (UID: "c94ba23e-6460-4d23-aaf8-2e526d1f3678"). InnerVolumeSpecName "kube-api-access-xc5w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:50:58.314561 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.314524    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc5w4\" (UniqueName: \"kubernetes.io/projected/c94ba23e-6460-4d23-aaf8-2e526d1f3678-kube-api-access-xc5w4\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:58.314561 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.314552    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:58.314561 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.314561    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c94ba23e-6460-4d23-aaf8-2e526d1f3678-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:50:58.495597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.495554    2565 generic.go:356] "Generic (PLEG): container finished" podID="c94ba23e-6460-4d23-aaf8-2e526d1f3678" containerID="b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6" exitCode=0
Sep 10 12:50:58.495784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.495623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq" event={"ID":"c94ba23e-6460-4d23-aaf8-2e526d1f3678","Type":"ContainerDied","Data":"b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6"}
Sep 10 12:50:58.495784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.495643    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"
Sep 10 12:50:58.495784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.495680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq" event={"ID":"c94ba23e-6460-4d23-aaf8-2e526d1f3678","Type":"ContainerDied","Data":"9b3b65b6992afc12ccbd4f0d74cbaaa7334eaf049714365f5c7ad51e299335ab"}
Sep 10 12:50:58.495784 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.495710    2565 scope.go:117] "RemoveContainer" containerID="b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6"
Sep 10 12:50:58.505808 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.505790    2565 scope.go:117] "RemoveContainer" containerID="b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6"
Sep 10 12:50:58.506106 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:50:58.506087    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6\": container with ID starting with b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6 not found: ID does not exist" containerID="b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6"
Sep 10 12:50:58.506156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.506115    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6"} err="failed to get container status \"b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6\": rpc error: code = NotFound desc = could not find container \"b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6\": container with ID starting with b4520e2988db8bcf2ba13e6e6ea48a704d1609691e6bb275d06d410614b8c0a6 not found: ID does not exist"
Sep 10 12:50:58.522247 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.522190    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"]
Sep 10 12:50:58.524403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:58.524383    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-714b74-7df997444-tlstq"]
Sep 10 12:50:59.395473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.395439    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c94ba23e-6460-4d23-aaf8-2e526d1f3678" path="/var/lib/kubelet/pods/c94ba23e-6460-4d23-aaf8-2e526d1f3678/volumes"
Sep 10 12:50:59.943758 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.943724    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7701-122cbb"]
Sep 10 12:50:59.944071 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944057    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7560938b-7407-4940-b12b-072edf8670db" containerName="maas-api"
Sep 10 12:50:59.944071 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944071    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7560938b-7407-4940-b12b-072edf8670db" containerName="maas-api"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944081    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c94ba23e-6460-4d23-aaf8-2e526d1f3678" containerName="maas-api"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944087    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c94ba23e-6460-4d23-aaf8-2e526d1f3678" containerName="maas-api"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944101    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944106    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944114    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944120    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944125    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91892db-f096-4c84-be0a-6f0a74c855ca" containerName="main"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944130    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91892db-f096-4c84-be0a-6f0a74c855ca" containerName="main"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944184    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944191    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c681bc0-4a39-40f1-aa97-93914bb411dd" containerName="istio-proxy"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944197    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7560938b-7407-4940-b12b-072edf8670db" containerName="maas-api"
Sep 10 12:50:59.944196 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944203    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91892db-f096-4c84-be0a-6f0a74c855ca" containerName="main"
Sep 10 12:50:59.944854 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.944242    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c94ba23e-6460-4d23-aaf8-2e526d1f3678" containerName="maas-api"
Sep 10 12:50:59.948526 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.948508    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7701-122cbb"
Sep 10 12:50:59.952501 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.952475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w7tsg\""
Sep 10 12:50:59.964988 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:50:59.964958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7701-122cbb"]
Sep 10 12:51:00.027941 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:00.027907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxlt6\" (UniqueName: \"kubernetes.io/projected/ce342e12-31f5-4370-b72d-33a4bd31719b-kube-api-access-jxlt6\") pod \"test-curl-7701-122cbb\" (UID: \"ce342e12-31f5-4370-b72d-33a4bd31719b\") " pod="opendatahub/test-curl-7701-122cbb"
Sep 10 12:51:00.128475 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:00.128426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxlt6\" (UniqueName: \"kubernetes.io/projected/ce342e12-31f5-4370-b72d-33a4bd31719b-kube-api-access-jxlt6\") pod \"test-curl-7701-122cbb\" (UID: \"ce342e12-31f5-4370-b72d-33a4bd31719b\") " pod="opendatahub/test-curl-7701-122cbb"
Sep 10 12:51:00.140734 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:00.140701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxlt6\" (UniqueName: \"kubernetes.io/projected/ce342e12-31f5-4370-b72d-33a4bd31719b-kube-api-access-jxlt6\") pod \"test-curl-7701-122cbb\" (UID: \"ce342e12-31f5-4370-b72d-33a4bd31719b\") " pod="opendatahub/test-curl-7701-122cbb"
Sep 10 12:51:00.258032 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:00.257942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7701-122cbb"
Sep 10 12:51:00.536378 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:00.536351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7701-122cbb"]
Sep 10 12:51:00.538224 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:51:00.538183    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce342e12_31f5_4370_b72d_33a4bd31719b.slice/crio-92ca9691836e96f59c2f9cffc84e85f43af7bc37d5962812d95f06fba211d41b WatchSource:0}: Error finding container 92ca9691836e96f59c2f9cffc84e85f43af7bc37d5962812d95f06fba211d41b: Status 404 returned error can't find the container with id 92ca9691836e96f59c2f9cffc84e85f43af7bc37d5962812d95f06fba211d41b
Sep 10 12:51:00.540145 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:00.540128    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:51:01.513865 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:01.513830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7701-122cbb" event={"ID":"ce342e12-31f5-4370-b72d-33a4bd31719b","Type":"ContainerStarted","Data":"92ca9691836e96f59c2f9cffc84e85f43af7bc37d5962812d95f06fba211d41b"}
Sep 10 12:51:02.520284 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:02.520246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7701-122cbb" event={"ID":"ce342e12-31f5-4370-b72d-33a4bd31719b","Type":"ContainerStarted","Data":"2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab"}
Sep 10 12:51:03.137037 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:03.136981    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7701-122cbb" podStartSLOduration=3.064079179 podStartE2EDuration="4.136958073s" totalImagesPullingTime="1.072878894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:02.543068813 +0000 UTC m=+1253.663423391" watchObservedRunningTime="2026-09-10 12:51:03.136958073 +0000 UTC m=+1254.257312651"
Sep 10 12:51:03.139244 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:03.139224    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7701-122cbb"]
Sep 10 12:51:03.145537 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:03.145511    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7701-122cbb"]
Sep 10 12:51:03.525914 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:51:03.525883    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7701-122cbb" container="test-curl-7701-122cbb"
Sep 10 12:51:04.530923 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:04.530881    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7701-122cbb" podUID="ce342e12-31f5-4370-b72d-33a4bd31719b" containerName="test-curl-7701-122cbb" containerID="cri-o://2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab" gracePeriod=2
Sep 10 12:51:06.719430 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:06.719400    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7701-122cbb"
Sep 10 12:51:06.781624 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:06.781593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxlt6\" (UniqueName: \"kubernetes.io/projected/ce342e12-31f5-4370-b72d-33a4bd31719b-kube-api-access-jxlt6\") pod \"ce342e12-31f5-4370-b72d-33a4bd31719b\" (UID: \"ce342e12-31f5-4370-b72d-33a4bd31719b\") "
Sep 10 12:51:06.783794 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:06.783760    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce342e12-31f5-4370-b72d-33a4bd31719b-kube-api-access-jxlt6" (OuterVolumeSpecName: "kube-api-access-jxlt6") pod "ce342e12-31f5-4370-b72d-33a4bd31719b" (UID: "ce342e12-31f5-4370-b72d-33a4bd31719b"). InnerVolumeSpecName "kube-api-access-jxlt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:51:06.889265 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:06.889195    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxlt6\" (UniqueName: \"kubernetes.io/projected/ce342e12-31f5-4370-b72d-33a4bd31719b-kube-api-access-jxlt6\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:51:07.396206 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:07.396169    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce342e12-31f5-4370-b72d-33a4bd31719b" path="/var/lib/kubelet/pods/ce342e12-31f5-4370-b72d-33a4bd31719b/volumes"
Sep 10 12:51:07.548733 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:07.548698    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce342e12-31f5-4370-b72d-33a4bd31719b" containerID="2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab" exitCode=137
Sep 10 12:51:07.548902 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:07.548741    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7701-122cbb"
Sep 10 12:51:07.548902 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:07.548797    2565 scope.go:117] "RemoveContainer" containerID="2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab"
Sep 10 12:51:07.557619 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:07.557596    2565 scope.go:117] "RemoveContainer" containerID="2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab"
Sep 10 12:51:07.557937 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:51:07.557913    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab\": container with ID starting with 2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab not found: ID does not exist" containerID="2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab"
Sep 10 12:51:07.558021 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:07.557948    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab"} err="failed to get container status \"2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab\": rpc error: code = NotFound desc = could not find container \"2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab\": container with ID starting with 2aac58499e0cf4432b91a788af94e1b3a9021ea2bd6f27615fef1d8b629640ab not found: ID does not exist"
Sep 10 12:51:10.188103 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.188071    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"]
Sep 10 12:51:10.188519 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.188489    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce342e12-31f5-4370-b72d-33a4bd31719b" containerName="test-curl-7701-122cbb"
Sep 10 12:51:10.188519 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.188505    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce342e12-31f5-4370-b72d-33a4bd31719b" containerName="test-curl-7701-122cbb"
Sep 10 12:51:10.188603 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.188567    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce342e12-31f5-4370-b72d-33a4bd31719b" containerName="test-curl-7701-122cbb"
Sep 10 12:51:10.193156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.193135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.196304 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.196283    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fce322fe-openshift-default-dockercfg-b6l8n\""
Sep 10 12:51:10.209021 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.208982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"]
Sep 10 12:51:10.220344 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcbt9\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-kube-api-access-xcbt9\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220344 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f396389-1218-4253-a66a-409f258f68ff-istio-podinfo\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f396389-1218-4253-a66a-409f258f68ff-istiod-ca-cert\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-socket\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-credential-socket\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-envoy\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-certs\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220598 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-data\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.220934 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.220651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-istio-token\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321371 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f396389-1218-4253-a66a-409f258f68ff-istiod-ca-cert\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-socket\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-credential-socket\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-envoy\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-certs\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-data\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321551 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-istio-token\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321791 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcbt9\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-kube-api-access-xcbt9\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321791 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f396389-1218-4253-a66a-409f258f68ff-istio-podinfo\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.321909 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-credential-socket\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.322047 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-socket\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.322047 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.321953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-certs\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.322175 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.322136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-data\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.322175 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.322163    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f396389-1218-4253-a66a-409f258f68ff-istiod-ca-cert\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.323971 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.323953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-envoy\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.324091 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.324076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f396389-1218-4253-a66a-409f258f68ff-istio-podinfo\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.330500 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.330470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-istio-token\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.330652 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.330634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcbt9\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-kube-api-access-xcbt9\") pod \"e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") " pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.503619 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.503534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:10.782459 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.782428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"]
Sep 10 12:51:10.784080 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:51:10.784049    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f396389_1218_4253_a66a_409f258f68ff.slice/crio-a2bc026fadc812bde64141eecf6a29ee8c60eca80ad767c47a2d58caa5c8be8f WatchSource:0}: Error finding container a2bc026fadc812bde64141eecf6a29ee8c60eca80ad767c47a2d58caa5c8be8f: Status 404 returned error can't find the container with id a2bc026fadc812bde64141eecf6a29ee8c60eca80ad767c47a2d58caa5c8be8f
Sep 10 12:51:10.786826 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.786789    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:10.786953 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.786870    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:10.786953 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.786912    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:10.839847 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.839814    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"]
Sep 10 12:51:10.844079 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.844059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.847029 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.847002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-c5adae-openshift-default-dockercfg-v6mdr\""
Sep 10 12:51:10.848076 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.848052    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"]
Sep 10 12:51:10.934980 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.934940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cda6db8-8074-428d-a189-4b600f34382b-istiod-ca-cert\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-certs\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp5dw\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-kube-api-access-hp5dw\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cda6db8-8074-428d-a189-4b600f34382b-istio-podinfo\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-envoy\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935189 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-credential-socket\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935549 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-data\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935549 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-istio-token\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:10.935549 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:10.935322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-socket\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036543 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-socket\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036543 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cda6db8-8074-428d-a189-4b600f34382b-istiod-ca-cert\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036543 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-certs\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036829 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp5dw\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-kube-api-access-hp5dw\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036829 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cda6db8-8074-428d-a189-4b600f34382b-istio-podinfo\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036829 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-envoy\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036829 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-credential-socket\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036829 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-data\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.036829 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-istio-token\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.037148 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.036978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-certs\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.037148 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.037090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-credential-socket\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.037330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.037288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-data\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.037509 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.037486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-socket\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.038081 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.038060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cda6db8-8074-428d-a189-4b600f34382b-istiod-ca-cert\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.039333 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.039307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-envoy\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.039669 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.039648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cda6db8-8074-428d-a189-4b600f34382b-istio-podinfo\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.046187 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.046165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-istio-token\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.046428 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.046412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp5dw\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-kube-api-access-hp5dw\") pod \"e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") " pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.163185 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.163146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:11.449840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.449814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"]
Sep 10 12:51:11.450772 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:51:11.450747    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cda6db8_8074_428d_a189_4b600f34382b.slice/crio-01d5d20ab0fb05c926e7e3111f643e8cea92a7257fc9d2a328f41e8a73f3176d WatchSource:0}: Error finding container 01d5d20ab0fb05c926e7e3111f643e8cea92a7257fc9d2a328f41e8a73f3176d: Status 404 returned error can't find the container with id 01d5d20ab0fb05c926e7e3111f643e8cea92a7257fc9d2a328f41e8a73f3176d
Sep 10 12:51:11.453092 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.453059    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:11.453174 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.453128    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:11.453174 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.453160    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:11.583510 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.583462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" event={"ID":"5cda6db8-8074-428d-a189-4b600f34382b","Type":"ContainerStarted","Data":"2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e"}
Sep 10 12:51:11.583709 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.583541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" event={"ID":"5cda6db8-8074-428d-a189-4b600f34382b","Type":"ContainerStarted","Data":"01d5d20ab0fb05c926e7e3111f643e8cea92a7257fc9d2a328f41e8a73f3176d"}
Sep 10 12:51:11.585266 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.585235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" event={"ID":"4f396389-1218-4253-a66a-409f258f68ff","Type":"ContainerStarted","Data":"9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1"}
Sep 10 12:51:11.585397 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.585290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" event={"ID":"4f396389-1218-4253-a66a-409f258f68ff","Type":"ContainerStarted","Data":"a2bc026fadc812bde64141eecf6a29ee8c60eca80ad767c47a2d58caa5c8be8f"}
Sep 10 12:51:11.607878 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.607796    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podStartSLOduration=1.607775847 podStartE2EDuration="1.607775847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:11.607247946 +0000 UTC m=+1262.727602520" watchObservedRunningTime="2026-09-10 12:51:11.607775847 +0000 UTC m=+1262.728130425"
Sep 10 12:51:11.632601 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:11.632553    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podStartSLOduration=1.6325360880000002 podStartE2EDuration="1.632536088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:11.630205822 +0000 UTC m=+1262.750560403" watchObservedRunningTime="2026-09-10 12:51:11.632536088 +0000 UTC m=+1262.752890664"
Sep 10 12:51:12.163377 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.163343    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:12.168679 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.168652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:12.504660 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.504619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:12.510372 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.510346    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:12.591493 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.591463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:12.591698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.591515    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:12.592552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.592529    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:12.592650 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:12.592585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:14.747831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.747786    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"]
Sep 10 12:51:14.752793 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.752764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.755683 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.755660    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-c5adae-serving-cert\""
Sep 10 12:51:14.762611 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.762586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"]
Sep 10 12:51:14.884186 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.884148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.884402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.884267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9bzx\" (UniqueName: \"kubernetes.io/projected/af559125-b33d-4b9c-b892-26013a9f1716-kube-api-access-p9bzx\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.884402 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.884380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af559125-b33d-4b9c-b892-26013a9f1716-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.884504 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.884481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.985527 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.985493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.985746 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.985542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.985746 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.985589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9bzx\" (UniqueName: \"kubernetes.io/projected/af559125-b33d-4b9c-b892-26013a9f1716-kube-api-access-p9bzx\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.985873 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:51:14.985740    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-serving-cert: secret "maas-api-e2e-shared-a-w3-c5adae-serving-cert" not found
Sep 10 12:51:14.985873 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.985750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af559125-b33d-4b9c-b892-26013a9f1716-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.985873 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:51:14.985813    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls podName:af559125-b33d-4b9c-b892-26013a9f1716 nodeName:}" failed. No retries permitted until 2026-09-10 12:51:15.485792227 +0000 UTC m=+1266.606146783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls") pod "maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" (UID: "af559125-b33d-4b9c-b892-26013a9f1716") : secret "maas-api-e2e-shared-a-w3-c5adae-serving-cert" not found
Sep 10 12:51:14.986548 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.986521    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af559125-b33d-4b9c-b892-26013a9f1716-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.988308 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.988278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:14.997713 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:14.997686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9bzx\" (UniqueName: \"kubernetes.io/projected/af559125-b33d-4b9c-b892-26013a9f1716-kube-api-access-p9bzx\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:15.491364 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:15.491330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:15.494021 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:15.493999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:15.666298 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:15.664995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:15.974229 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:15.969669    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"]
Sep 10 12:51:15.974622 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:51:15.974298    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf559125_b33d_4b9c_b892_26013a9f1716.slice/crio-bc6233d63a7a209b1a95bc4ea50a5292c4f42c6c3c9ce19c6159b88537854373 WatchSource:0}: Error finding container bc6233d63a7a209b1a95bc4ea50a5292c4f42c6c3c9ce19c6159b88537854373: Status 404 returned error can't find the container with id bc6233d63a7a209b1a95bc4ea50a5292c4f42c6c3c9ce19c6159b88537854373
Sep 10 12:51:16.614794 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:16.614760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" event={"ID":"af559125-b33d-4b9c-b892-26013a9f1716","Type":"ContainerStarted","Data":"d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6"}
Sep 10 12:51:16.614970 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:16.614815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" event={"ID":"af559125-b33d-4b9c-b892-26013a9f1716","Type":"ContainerStarted","Data":"bc6233d63a7a209b1a95bc4ea50a5292c4f42c6c3c9ce19c6159b88537854373"}
Sep 10 12:51:16.614970 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:16.614842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:16.634449 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:16.634400    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" podStartSLOduration=2.12724437 podStartE2EDuration="2.63438532s" totalImagesPullingTime="507.14095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:51:16.632425206 +0000 UTC m=+1267.752779784" watchObservedRunningTime="2026-09-10 12:51:16.63438532 +0000 UTC m=+1267.754739897"
Sep 10 12:51:22.625279 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:22.625250    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 12:51:43.632385 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:43.632345    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 12:51:43.632862 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:43.632426    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 12:51:43.632862 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:43.632425    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 12:51:43.632862 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:43.632475    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 12:51:44.789778 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.789745    2565 generic.go:356] "Generic (PLEG): container finished" podID="5cda6db8-8074-428d-a189-4b600f34382b" containerID="2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e" exitCode=0
Sep 10 12:51:44.790339 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.789828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" event={"ID":"5cda6db8-8074-428d-a189-4b600f34382b","Type":"ContainerDied","Data":"2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e"}
Sep 10 12:51:44.790417 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.790364    2565 scope.go:117] "RemoveContainer" containerID="2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e"
Sep 10 12:51:44.792697 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.792654    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:44.792840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.792757    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:44.792840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.792810    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:44.795855 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.794880    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f396389-1218-4253-a66a-409f258f68ff" containerID="9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1" exitCode=0
Sep 10 12:51:44.795855 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.795011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" event={"ID":"4f396389-1218-4253-a66a-409f258f68ff","Type":"ContainerDied","Data":"9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1"}
Sep 10 12:51:44.795855 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.795467    2565 scope.go:117] "RemoveContainer" containerID="9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1"
Sep 10 12:51:44.796965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.796927    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:44.796965 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.797020    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:44.797173 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:44.797065    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:51:45.801874 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:45.801839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" event={"ID":"5cda6db8-8074-428d-a189-4b600f34382b","Type":"ContainerStarted","Data":"1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040"}
Sep 10 12:51:45.803936 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:45.803914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" event={"ID":"4f396389-1218-4253-a66a-409f258f68ff","Type":"ContainerStarted","Data":"584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9"}
Sep 10 12:51:46.163865 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:46.163757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:46.164085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:46.164052    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 10 12:51:46.164162 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:46.164130    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 10 12:51:46.504193 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:46.504148    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:46.504440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:46.504319    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 10 12:51:46.504440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:46.504366    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 10 12:51:47.164371 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:47.164336    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 10 12:51:47.164744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:47.164394    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 10 12:51:47.504565 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:47.504506    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 10 12:51:47.504777 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:47.504599    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 10 12:51:48.164311 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:48.164274    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 10 12:51:48.164496 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:48.164334    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 10 12:51:48.504956 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:48.504915    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 10 12:51:48.505306 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:48.505274    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 10 12:51:49.163680 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:49.163594    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 10 12:51:49.163680 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:49.163648    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 10 12:51:49.505045 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:49.505006    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 10 12:51:49.505676 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:49.505645    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 10 12:51:50.164030 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:50.163995    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 10 12:51:50.164235 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:50.164062    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 10 12:51:50.504204 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:50.504156    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 10 12:51:50.504451 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:50.504257    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 10 12:51:51.163878 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:51.163842    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 10 12:51:51.164297 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:51.163903    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 10 12:51:51.504616 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:51.504569    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 10 12:51:51.504839 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:51.504641    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 10 12:51:52.168023 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:52.167992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:52.168477 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:52.168397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:52.168961 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:52.168942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 12:51:52.508234 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:52.508192    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:52.508523 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:52.508501    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:51:52.509127 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:51:52.509111    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:52:27.625066 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.625034    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"]
Sep 10 12:52:27.627499 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.627483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.631673 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.631647    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fce322fe\"/\"default-dockercfg-fdxz8\""
Sep 10 12:52:27.631816 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.631648    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fce322fe\"/\"e2e-lifecycle-model-fce322fe-kserve-self-signed-certs\""
Sep 10 12:52:27.631816 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.631698    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fce322fe\"/\"openshift-service-ca.crt\""
Sep 10 12:52:27.631816 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.631742    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fce322fe\"/\"kube-root-ca.crt\""
Sep 10 12:52:27.638888 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.638863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"]
Sep 10 12:52:27.716597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.716566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-dshm\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.716768 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.716625    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-kube-api-access-r7khx\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.716768 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.716663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-home\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.716768 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.716738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tmp-dir\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.716768 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.716761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-model-cache\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.716912 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.716776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tls-certs\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.818348 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.818312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-model-cache\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.818595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.818576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tls-certs\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.818720 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.818706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-dshm\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.818880 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.818864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-kube-api-access-r7khx\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.819026 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.819011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-home\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.819322 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.819167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-model-cache\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.819322 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.819188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tmp-dir\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.819830 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.819533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tmp-dir\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.820092 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.820070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-home\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.823391 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.823368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-dshm\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.825622 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.825578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tls-certs\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.830568 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.830545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-kube-api-access-r7khx\") pod \"e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") " pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:27.937765 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:27.937733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:28.213451 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:28.213426    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"]
Sep 10 12:52:28.214972 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:52:28.214945    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae42ffc_6b8b_4ff2_8421_c7274ff0e5d1.slice/crio-9a88b3e19ad05603832e83917c97828e8895022d61f130d9fd1b94c04e7b4618 WatchSource:0}: Error finding container 9a88b3e19ad05603832e83917c97828e8895022d61f130d9fd1b94c04e7b4618: Status 404 returned error can't find the container with id 9a88b3e19ad05603832e83917c97828e8895022d61f130d9fd1b94c04e7b4618
Sep 10 12:52:29.050525 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:29.050484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx" event={"ID":"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1","Type":"ContainerStarted","Data":"84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46"}
Sep 10 12:52:29.051105 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:29.050536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx" event={"ID":"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1","Type":"ContainerStarted","Data":"9a88b3e19ad05603832e83917c97828e8895022d61f130d9fd1b94c04e7b4618"}
Sep 10 12:52:29.072942 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:29.072891    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx" podStartSLOduration=2.072876039 podStartE2EDuration="2.072876039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:52:29.070865393 +0000 UTC m=+1340.191219970" watchObservedRunningTime="2026-09-10 12:52:29.072876039 +0000 UTC m=+1340.193230616"
Sep 10 12:52:37.938483 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.938399    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:37.938483 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.938460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:37.951142 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.951111    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:37.957129 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.957103    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"]
Sep 10 12:52:37.959269 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.959254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:37.964771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.964750    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1312ea\"/\"kube-root-ca.crt\""
Sep 10 12:52:37.964935 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.964913    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1312ea\"/\"default-dockercfg-q5q96\""
Sep 10 12:52:37.965638 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.965618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1312ea\"/\"unconfigured-w4-1312ea-kserve-self-signed-certs\""
Sep 10 12:52:37.967586 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.967568    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1312ea\"/\"openshift-service-ca.crt\""
Sep 10 12:52:37.975552 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:37.975532    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"]
Sep 10 12:52:38.023271 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.023234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-home\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.023452 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.023281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-dshm\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.023452 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.023334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-model-cache\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.023561 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.023463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tmp-dir\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.023561 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.023514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tls-certs\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.023634 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.023556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgq4v\" (UniqueName: \"kubernetes.io/projected/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-kube-api-access-sgq4v\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.110895 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.110865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:52:38.124925 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.124899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tls-certs\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125052 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.124932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgq4v\" (UniqueName: \"kubernetes.io/projected/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-kube-api-access-sgq4v\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125093 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.125063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-home\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125133 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.125098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-dshm\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125174 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.125149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-model-cache\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125261 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.125201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tmp-dir\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125531 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.125501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-home\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125824 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.125542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tmp-dir\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.125824 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.125570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-model-cache\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.127459 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.127438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-dshm\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.127599 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.127583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tls-certs\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.149789 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.149756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgq4v\" (UniqueName: \"kubernetes.io/projected/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-kube-api-access-sgq4v\") pod \"unconfigured-w4-1312ea-kserve-64b59cb665-78j7p\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") " pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.268723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.268637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:38.561239 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:38.561193    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"]
Sep 10 12:52:38.562769 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:52:38.562743    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e4e4b72_d983_4c67_bfe3_0da7ac10353b.slice/crio-219d61bc1132c1a88bffa54d5688a701fcdb6f58963ddbb31b21220ea9b1bcbf WatchSource:0}: Error finding container 219d61bc1132c1a88bffa54d5688a701fcdb6f58963ddbb31b21220ea9b1bcbf: Status 404 returned error can't find the container with id 219d61bc1132c1a88bffa54d5688a701fcdb6f58963ddbb31b21220ea9b1bcbf
Sep 10 12:52:39.107010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:39.106972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p" event={"ID":"1e4e4b72-d983-4c67-bfe3-0da7ac10353b","Type":"ContainerStarted","Data":"c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5"}
Sep 10 12:52:39.107010 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:39.107017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p" event={"ID":"1e4e4b72-d983-4c67-bfe3-0da7ac10353b","Type":"ContainerStarted","Data":"219d61bc1132c1a88bffa54d5688a701fcdb6f58963ddbb31b21220ea9b1bcbf"}
Sep 10 12:52:39.125880 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:39.125817    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p" podStartSLOduration=2.12580151 podStartE2EDuration="2.12580151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:52:39.12550475 +0000 UTC m=+1350.245859326" watchObservedRunningTime="2026-09-10 12:52:39.12580151 +0000 UTC m=+1350.246156083"
Sep 10 12:52:48.269406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:48.269370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:48.269811 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:48.269681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:48.281926 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:48.281894    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:52:49.172027 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:52:49.171947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:54:11.286224 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:11.286183    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"]
Sep 10 12:54:26.306538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.306495    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx" podUID="1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" containerName="main" containerID="cri-o://84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46" gracePeriod=45
Sep 10 12:54:26.553406 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.553383    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:54:26.621485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.621392    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tls-certs\") pod \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") "
Sep 10 12:54:26.621660 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.621528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tmp-dir\") pod \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") "
Sep 10 12:54:26.621660 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.621563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-kube-api-access-r7khx\") pod \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") "
Sep 10 12:54:26.621660 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.621590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-dshm\") pod \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") "
Sep 10 12:54:26.621821 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.621677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-home\") pod \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") "
Sep 10 12:54:26.621821 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.621702    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-model-cache\") pod \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\" (UID: \"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1\") "
Sep 10 12:54:26.621932 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.621821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" (UID: "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:54:26.622053 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.622029    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" (UID: "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:54:26.622053 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.622010    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-home" (OuterVolumeSpecName: "home") pod "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" (UID: "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:54:26.622278 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.622225    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tmp-dir\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:54:26.622278 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.622248    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-home\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:54:26.622278 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.622261    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-model-cache\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:54:26.623978 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.623949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-dshm" (OuterVolumeSpecName: "dshm") pod "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" (UID: "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:54:26.624261 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.624241    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" (UID: "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:54:26.624554 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.624520    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-kube-api-access-r7khx" (OuterVolumeSpecName: "kube-api-access-r7khx") pod "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" (UID: "1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1"). InnerVolumeSpecName "kube-api-access-r7khx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:54:26.693573 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.693540    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" containerID="84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46" exitCode=0
Sep 10 12:54:26.693780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.693604    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"
Sep 10 12:54:26.693780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.693626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx" event={"ID":"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1","Type":"ContainerDied","Data":"84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46"}
Sep 10 12:54:26.693780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.693678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx" event={"ID":"1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1","Type":"ContainerDied","Data":"9a88b3e19ad05603832e83917c97828e8895022d61f130d9fd1b94c04e7b4618"}
Sep 10 12:54:26.693780 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.693700    2565 scope.go:117] "RemoveContainer" containerID="84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46"
Sep 10 12:54:26.705401 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.705380    2565 scope.go:117] "RemoveContainer" containerID="84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46"
Sep 10 12:54:26.705708 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:54:26.705689    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46\": container with ID starting with 84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46 not found: ID does not exist" containerID="84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46"
Sep 10 12:54:26.705773 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.705720    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46"} err="failed to get container status \"84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46\": rpc error: code = NotFound desc = could not find container \"84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46\": container with ID starting with 84e2861c9cdf705507d5b634f2509387a2db04cf02718100f6666b1398807a46 not found: ID does not exist"
Sep 10 12:54:26.723280 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.723240    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7khx\" (UniqueName: \"kubernetes.io/projected/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-kube-api-access-r7khx\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:54:26.723280 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.723281    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-dshm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:54:26.723280 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.723293    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1-tls-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:54:26.723542 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.723523    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"]
Sep 10 12:54:26.734639 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:26.734612    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-fce322fe/e2e-lifecycle-model-fce322fe-kserve-f7b4b4c99-zqmhx"]
Sep 10 12:54:27.395133 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:27.395098    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" path="/var/lib/kubelet/pods/1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1/volumes"
Sep 10 12:54:46.515343 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.515306    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"]
Sep 10 12:54:46.515723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.515681    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" containerName="main"
Sep 10 12:54:46.515723 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.515692    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" containerName="main"
Sep 10 12:54:46.515795 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.515764    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae42ffc-6b8b-4ff2-8421-c7274ff0e5d1" containerName="main"
Sep 10 12:54:46.518738 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.518721    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.538576 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.538548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-30919a\"/\"embedding-w0-30919a-kserve-self-signed-certs\""
Sep 10 12:54:46.552340 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.552313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"]
Sep 10 12:54:46.629754 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.629724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-dshm\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.629940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.629761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-home\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.629940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.629782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-model-cache\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.629940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.629803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602869f1-8899-4830-bab9-0d9d4c320584-tls-certs\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.629940 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.629868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxlf\" (UniqueName: \"kubernetes.io/projected/602869f1-8899-4830-bab9-0d9d4c320584-kube-api-access-mrxlf\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.630085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.630006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-tmp-dir\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.731539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-home\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.731539 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-model-cache\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.731766 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602869f1-8899-4830-bab9-0d9d4c320584-tls-certs\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.731766 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxlf\" (UniqueName: \"kubernetes.io/projected/602869f1-8899-4830-bab9-0d9d4c320584-kube-api-access-mrxlf\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.731875 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-tmp-dir\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.731911 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-model-cache\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.731954 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-home\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.732017 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.731997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-dshm\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.732147 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.732124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-tmp-dir\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.734134 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.734110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-dshm\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.734335 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.734317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602869f1-8899-4830-bab9-0d9d4c320584-tls-certs\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.784413 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.784338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxlf\" (UniqueName: \"kubernetes.io/projected/602869f1-8899-4830-bab9-0d9d4c320584-kube-api-access-mrxlf\") pod \"embedding-w0-30919a-kserve-6f9789466f-68nml\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") " pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:46.828018 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:46.827985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:47.146951 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:47.146924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"]
Sep 10 12:54:47.147939 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:54:47.147911    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod602869f1_8899_4830_bab9_0d9d4c320584.slice/crio-c6554d046230c41c1e07f755acdae3da45441be2c0e3d29c09e0bc68c804d8fd WatchSource:0}: Error finding container c6554d046230c41c1e07f755acdae3da45441be2c0e3d29c09e0bc68c804d8fd: Status 404 returned error can't find the container with id c6554d046230c41c1e07f755acdae3da45441be2c0e3d29c09e0bc68c804d8fd
Sep 10 12:54:47.809076 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:47.809034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml" event={"ID":"602869f1-8899-4830-bab9-0d9d4c320584","Type":"ContainerStarted","Data":"eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856"}
Sep 10 12:54:47.809076 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:47.809078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml" event={"ID":"602869f1-8899-4830-bab9-0d9d4c320584","Type":"ContainerStarted","Data":"c6554d046230c41c1e07f755acdae3da45441be2c0e3d29c09e0bc68c804d8fd"}
Sep 10 12:54:47.848090 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:47.848040    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml" podStartSLOduration=1.848024397 podStartE2EDuration="1.848024397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:54:47.847472337 +0000 UTC m=+1478.967826913" watchObservedRunningTime="2026-09-10 12:54:47.848024397 +0000 UTC m=+1478.968379001"
Sep 10 12:54:56.828324 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:56.828285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:56.828743 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:56.828338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:56.840968 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:56.840942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:54:56.867396 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:54:56.867366    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:55:36.609309 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:36.609228    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"]
Sep 10 12:55:36.609775 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:36.609445    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" containerID="cri-o://584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9" gracePeriod=30
Sep 10 12:55:37.511352 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:37.511311    2565 patch_prober.go:28] interesting pod/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:55:37.511535 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:37.511416    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:55:41.858484 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:41.858458    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:55:42.000077 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-data\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000287 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-certs\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000287 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-envoy\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000287 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000152    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-socket\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000287 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-istio-token\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000287 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-credential-socket\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000579 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcbt9\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-kube-api-access-xcbt9\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000579 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000343    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f396389-1218-4253-a66a-409f258f68ff-istiod-ca-cert\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000579 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f396389-1218-4253-a66a-409f258f68ff-istio-podinfo\") pod \"4f396389-1218-4253-a66a-409f258f68ff\" (UID: \"4f396389-1218-4253-a66a-409f258f68ff\") "
Sep 10 12:55:42.000579 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:55:42.000579 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:55:42.000848 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000572    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:55:42.000848 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:55:42.000848 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000787    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f396389-1218-4253-a66a-409f258f68ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:55:42.000977 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000851    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.000977 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000869    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.000977 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000885    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.000977 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.000897    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.002589 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.002558    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:55:42.002712 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.002605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-kube-api-access-xcbt9" (OuterVolumeSpecName: "kube-api-access-xcbt9") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "kube-api-access-xcbt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:55:42.002961 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.002932    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f396389-1218-4253-a66a-409f258f68ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:55:42.002961 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.002944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f396389-1218-4253-a66a-409f258f68ff" (UID: "4f396389-1218-4253-a66a-409f258f68ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:55:42.102285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.102249    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcbt9\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-kube-api-access-xcbt9\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.102285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.102277    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f396389-1218-4253-a66a-409f258f68ff-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.102285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.102286    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f396389-1218-4253-a66a-409f258f68ff-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.102285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.102295    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f396389-1218-4253-a66a-409f258f68ff-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.102576 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.102303    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f396389-1218-4253-a66a-409f258f68ff-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:55:42.114342 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.114306    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f396389-1218-4253-a66a-409f258f68ff" containerID="584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9" exitCode=0
Sep 10 12:55:42.114495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.114354    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"
Sep 10 12:55:42.114495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.114370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" event={"ID":"4f396389-1218-4253-a66a-409f258f68ff","Type":"ContainerDied","Data":"584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9"}
Sep 10 12:55:42.114495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.114415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb" event={"ID":"4f396389-1218-4253-a66a-409f258f68ff","Type":"ContainerDied","Data":"a2bc026fadc812bde64141eecf6a29ee8c60eca80ad767c47a2d58caa5c8be8f"}
Sep 10 12:55:42.114495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.114437    2565 scope.go:117] "RemoveContainer" containerID="584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9"
Sep 10 12:55:42.130263 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.125069    2565 scope.go:117] "RemoveContainer" containerID="9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1"
Sep 10 12:55:42.139143 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.139123    2565 scope.go:117] "RemoveContainer" containerID="584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9"
Sep 10 12:55:42.139486 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:55:42.139466    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9\": container with ID starting with 584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9 not found: ID does not exist" containerID="584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9"
Sep 10 12:55:42.139533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.139494    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9"} err="failed to get container status \"584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9\": rpc error: code = NotFound desc = could not find container \"584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9\": container with ID starting with 584ff316294367d6ec271696f974f0174e4076fe4f5797fba887f567707d77a9 not found: ID does not exist"
Sep 10 12:55:42.139533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.139512    2565 scope.go:117] "RemoveContainer" containerID="9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1"
Sep 10 12:55:42.139766 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:55:42.139751    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1\": container with ID starting with 9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1 not found: ID does not exist" containerID="9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1"
Sep 10 12:55:42.139802 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.139771    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1"} err="failed to get container status \"9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1\": rpc error: code = NotFound desc = could not find container \"9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1\": container with ID starting with 9438c4d4c0733ca77f12fab8730762daa5a3a730fe85f77a82606b935c7171b1 not found: ID does not exist"
Sep 10 12:55:42.162977 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.162943    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"]
Sep 10 12:55:42.170128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:42.170100    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fce322fe-openshift-default-6f8c4f988d-j5pjb"]
Sep 10 12:55:43.395382 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:55:43.395352    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f396389-1218-4253-a66a-409f258f68ff" path="/var/lib/kubelet/pods/4f396389-1218-4253-a66a-409f258f68ff/volumes"
Sep 10 12:56:40.940873 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.940840    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"]
Sep 10 12:56:40.941357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.941223    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy"
Sep 10 12:56:40.941357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.941239    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy"
Sep 10 12:56:40.941357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.941259    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy"
Sep 10 12:56:40.941357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.941266    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy"
Sep 10 12:56:40.941357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.941332    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy"
Sep 10 12:56:40.941357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.941340    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f396389-1218-4253-a66a-409f258f68ff" containerName="istio-proxy"
Sep 10 12:56:40.944386 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.944370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.950025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.950004    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fe8579-openshift-default-dockercfg-6fpmj\""
Sep 10 12:56:40.966644 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-certs\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.966776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-istio-token\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.966776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-socket\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.966776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-credential-socket\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.966907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-data\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.966907 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-envoy\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.966985 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c76b11-1cf8-4675-bdca-b012b8815248-istio-podinfo\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.967038 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.966984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5qhz\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-kube-api-access-f5qhz\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:40.967109 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.967090    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"]
Sep 10 12:56:40.967165 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:40.967115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c76b11-1cf8-4675-bdca-b012b8815248-istiod-ca-cert\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068185 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-certs\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068185 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-istio-token\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068450 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-socket\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068450 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-credential-socket\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068450 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-data\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068450 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-envoy\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068682 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c76b11-1cf8-4675-bdca-b012b8815248-istio-podinfo\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068682 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5qhz\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-kube-api-access-f5qhz\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068682 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-certs\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068682 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-socket\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068682 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c76b11-1cf8-4675-bdca-b012b8815248-istiod-ca-cert\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068872 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-credential-socket\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.068872 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.068712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-data\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.069206 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.069189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c76b11-1cf8-4675-bdca-b012b8815248-istiod-ca-cert\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.070834 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.070805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-envoy\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.071049 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.071005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c76b11-1cf8-4675-bdca-b012b8815248-istio-podinfo\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.100180 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.100156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-istio-token\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.100413 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.100249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5qhz\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-kube-api-access-f5qhz\") pod \"e2e-api-a-fe8579-openshift-default-767d544976-5f4w2\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") " pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.255154 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.255072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:41.552943 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:56:41.552917    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c76b11_1cf8_4675_bdca_b012b8815248.slice/crio-14e5683c1b3eb38fc2c322b4b91163448570e504ad59f0025a641cb20440758a WatchSource:0}: Error finding container 14e5683c1b3eb38fc2c322b4b91163448570e504ad59f0025a641cb20440758a: Status 404 returned error can't find the container with id 14e5683c1b3eb38fc2c322b4b91163448570e504ad59f0025a641cb20440758a
Sep 10 12:56:41.554333 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.554312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"]
Sep 10 12:56:41.555487 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.555454    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:56:41.555597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.555532    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:56:41.555597 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:41.555581    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:56:42.441760 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:42.441722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" event={"ID":"79c76b11-1cf8-4675-bdca-b012b8815248","Type":"ContainerStarted","Data":"a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb"}
Sep 10 12:56:42.442139 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:42.441776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" event={"ID":"79c76b11-1cf8-4675-bdca-b012b8815248","Type":"ContainerStarted","Data":"14e5683c1b3eb38fc2c322b4b91163448570e504ad59f0025a641cb20440758a"}
Sep 10 12:56:42.502649 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:42.502596    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" podStartSLOduration=2.502581164 podStartE2EDuration="2.502581164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:56:42.501241768 +0000 UTC m=+1593.621596344" watchObservedRunningTime="2026-09-10 12:56:42.502581164 +0000 UTC m=+1593.622935740"
Sep 10 12:56:43.258170 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:43.258129    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:43.263729 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:43.263704    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:43.447713 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:43.447679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:56:43.448473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:56:43.448453    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:57:10.472334 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.472293    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"]
Sep 10 12:57:10.475874 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.475853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.480296 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.480278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b3c07b-openshift-default-dockercfg-f9b86\""
Sep 10 12:57:10.503549 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.503520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"]
Sep 10 12:57:10.570028 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.569985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-podinfo\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570266 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-credential-socket\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570266 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istiod-ca-cert\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570266 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-token\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570455 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-certs\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570455 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-envoy\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570455 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjswn\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-kube-api-access-wjswn\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570455 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-data\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.570665 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.570469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-socket\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.671641 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.671555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-credential-socket\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.671840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.671653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istiod-ca-cert\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.671840 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.671704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-token\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.671975 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.671903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-certs\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672062 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.671991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-envoy\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672062 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjswn\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-kube-api-access-wjswn\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672062 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.671989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-credential-socket\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-data\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-socket\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-podinfo\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-certs\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672531 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-data\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672531 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istiod-ca-cert\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.672614 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.672526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-socket\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.674334 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.674314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-envoy\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.674724 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.674708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-podinfo\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.719110 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.719076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-token\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.722556 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.722481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjswn\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-kube-api-access-wjswn\") pod \"e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") " pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:10.791769 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:10.789770    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:11.107667 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.107642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"]
Sep 10 12:57:11.110237 ip-10-0-130-88 kubenswrapper[2565]: W0910 12:57:11.110191    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8468ce_b35c_4bc2_969d_e751f3675b8d.slice/crio-7421eb956c10d5ed2581eb1ead4a17ba16e4ae3e493114815a99bf872abf709a WatchSource:0}: Error finding container 7421eb956c10d5ed2581eb1ead4a17ba16e4ae3e493114815a99bf872abf709a: Status 404 returned error can't find the container with id 7421eb956c10d5ed2581eb1ead4a17ba16e4ae3e493114815a99bf872abf709a
Sep 10 12:57:11.112675 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.112641    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:11.112744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.112715    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:11.112786 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.112743    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:11.604141 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.604109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" event={"ID":"ea8468ce-b35c-4bc2-969d-e751f3675b8d","Type":"ContainerStarted","Data":"8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22"}
Sep 10 12:57:11.604543 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.604169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" event={"ID":"ea8468ce-b35c-4bc2-969d-e751f3675b8d","Type":"ContainerStarted","Data":"7421eb956c10d5ed2581eb1ead4a17ba16e4ae3e493114815a99bf872abf709a"}
Sep 10 12:57:11.633259 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.633181    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podStartSLOduration=1.633163809 podStartE2EDuration="1.633163809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:57:11.631462996 +0000 UTC m=+1622.751817576" watchObservedRunningTime="2026-09-10 12:57:11.633163809 +0000 UTC m=+1622.753518386"
Sep 10 12:57:11.791039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:11.790999    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:12.808767 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:12.808727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:13.618310 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:13.618275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:13.619416 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:13.619396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:21.665195 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:21.665157    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c76b11-1cf8-4675-bdca-b012b8815248" containerID="a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb" exitCode=0
Sep 10 12:57:21.665633 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:21.665236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" event={"ID":"79c76b11-1cf8-4675-bdca-b012b8815248","Type":"ContainerDied","Data":"a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb"}
Sep 10 12:57:21.665678 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:21.665633    2565 scope.go:117] "RemoveContainer" containerID="a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb"
Sep 10 12:57:21.666817 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:21.666790    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:21.666868 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:21.666856    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:21.666917 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:21.666905    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:22.673222 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:22.673176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" event={"ID":"79c76b11-1cf8-4675-bdca-b012b8815248","Type":"ContainerStarted","Data":"c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca"}
Sep 10 12:57:23.255891 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:23.255855    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:57:23.256085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:23.256005    2565 patch_prober.go:28] interesting pod/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 12:57:23.256085 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:23.256043    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 12:57:24.255614 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:24.255579    2565 patch_prober.go:28] interesting pod/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 12:57:24.255990 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:24.255635    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 12:57:25.255932 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:25.255888    2565 patch_prober.go:28] interesting pod/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 12:57:25.256437 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:25.255952    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 12:57:26.255799 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:26.255757    2565 patch_prober.go:28] interesting pod/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 12:57:26.256014 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:26.255818    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 12:57:27.255635 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:27.255598    2565 patch_prober.go:28] interesting pod/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 12:57:27.255815 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:27.255662    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 12:57:28.260440 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:28.260410    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:57:28.260818 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:28.260683    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:57:28.261463 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:28.261448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:57:41.790647 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:41.790572    2565 generic.go:356] "Generic (PLEG): container finished" podID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerID="8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22" exitCode=0
Sep 10 12:57:41.790647 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:41.790631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" event={"ID":"ea8468ce-b35c-4bc2-969d-e751f3675b8d","Type":"ContainerDied","Data":"8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22"}
Sep 10 12:57:41.791068 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:41.791053    2565 scope.go:117] "RemoveContainer" containerID="8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22"
Sep 10 12:57:41.792361 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:41.792329    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:41.792465 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:41.792399    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:41.792465 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:41.792447    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 12:57:42.801830 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:42.801782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" event={"ID":"ea8468ce-b35c-4bc2-969d-e751f3675b8d","Type":"ContainerStarted","Data":"dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2"}
Sep 10 12:57:43.618836 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:43.618800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:43.792156 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:43.792115    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:43.793034 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:43.792999    2565 patch_prober.go:28] interesting pod/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 12:57:43.793172 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:43.793065    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 12:57:44.791334 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:44.791294    2565 patch_prober.go:28] interesting pod/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 12:57:44.791851 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:44.791362    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 12:57:45.791043 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:45.791005    2565 patch_prober.go:28] interesting pod/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 12:57:45.791403 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:45.791361    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 12:57:46.791678 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:46.791640    2565 patch_prober.go:28] interesting pod/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 12:57:46.792316 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:46.792282    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 12:57:47.791183 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:47.791144    2565 patch_prober.go:28] interesting pod/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 12:57:47.791640 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:47.791604    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 12:57:48.796594 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:48.796562    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:57:48.797755 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:57:48.797730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:58:06.116833 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:06.116800    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"]
Sep 10 12:58:06.117204 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:06.117002    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy" containerID="cri-o://c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca" gracePeriod=30
Sep 10 12:58:11.370894 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.370867    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:58:11.509330 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509289    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-istio-token\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c76b11-1cf8-4675-bdca-b012b8815248-istiod-ca-cert\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-certs\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-socket\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509467    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-envoy\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509496    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-credential-socket\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509517    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-data\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509538    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c76b11-1cf8-4675-bdca-b012b8815248-istio-podinfo\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509563 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509559    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5qhz\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-kube-api-access-f5qhz\") pod \"79c76b11-1cf8-4675-bdca-b012b8815248\" (UID: \"79c76b11-1cf8-4675-bdca-b012b8815248\") "
Sep 10 12:58:11.509937 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:11.509937 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c76b11-1cf8-4675-bdca-b012b8815248-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:58:11.509937 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509903    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-data" (OuterVolumeSpecName: "istio-data") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:11.510102 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509996    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:11.510252 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.510232    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c76b11-1cf8-4675-bdca-b012b8815248-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.510342 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.510261    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.510342 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.510274    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.510342 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.510286    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.510342 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.509808    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:11.511816 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.511780    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-istio-token" (OuterVolumeSpecName: "istio-token") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:11.512026 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.512007    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79c76b11-1cf8-4675-bdca-b012b8815248-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:58:11.512261 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.512238    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:11.512482 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.512464    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-kube-api-access-f5qhz" (OuterVolumeSpecName: "kube-api-access-f5qhz") pod "79c76b11-1cf8-4675-bdca-b012b8815248" (UID: "79c76b11-1cf8-4675-bdca-b012b8815248"). InnerVolumeSpecName "kube-api-access-f5qhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:11.611186 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.611156    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.611186 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.611181    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.611186 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.611190    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c76b11-1cf8-4675-bdca-b012b8815248-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.611453 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.611200    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c76b11-1cf8-4675-bdca-b012b8815248-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.611453 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.611236    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5qhz\" (UniqueName: \"kubernetes.io/projected/79c76b11-1cf8-4675-bdca-b012b8815248-kube-api-access-f5qhz\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:11.979745 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.979714    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c76b11-1cf8-4675-bdca-b012b8815248" containerID="c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca" exitCode=0
Sep 10 12:58:11.979960 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.979780    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"
Sep 10 12:58:11.979960 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.979812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" event={"ID":"79c76b11-1cf8-4675-bdca-b012b8815248","Type":"ContainerDied","Data":"c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca"}
Sep 10 12:58:11.979960 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.979871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2" event={"ID":"79c76b11-1cf8-4675-bdca-b012b8815248","Type":"ContainerDied","Data":"14e5683c1b3eb38fc2c322b4b91163448570e504ad59f0025a641cb20440758a"}
Sep 10 12:58:11.979960 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.979894    2565 scope.go:117] "RemoveContainer" containerID="c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca"
Sep 10 12:58:11.989726 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.989710    2565 scope.go:117] "RemoveContainer" containerID="a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb"
Sep 10 12:58:11.997875 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.997859    2565 scope.go:117] "RemoveContainer" containerID="c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca"
Sep 10 12:58:11.998138 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:11.998121    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca\": container with ID starting with c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca not found: ID does not exist" containerID="c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca"
Sep 10 12:58:11.998200 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.998144    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca"} err="failed to get container status \"c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca\": rpc error: code = NotFound desc = could not find container \"c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca\": container with ID starting with c98d7e6c439656d2a647743ae12b8833ceedb4cb09603735d6fb121708ed28ca not found: ID does not exist"
Sep 10 12:58:11.998200 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.998160    2565 scope.go:117] "RemoveContainer" containerID="a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb"
Sep 10 12:58:11.998427 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:11.998411    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb\": container with ID starting with a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb not found: ID does not exist" containerID="a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb"
Sep 10 12:58:11.998464 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:11.998442    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb"} err="failed to get container status \"a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb\": rpc error: code = NotFound desc = could not find container \"a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb\": container with ID starting with a3247db0ca54356fd99f53b1210a05a28dfec5333b0f1869f8ce242eb184aadb not found: ID does not exist"
Sep 10 12:58:12.010754 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:12.010733    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"]
Sep 10 12:58:12.017755 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:12.017736    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fe8579-openshift-default-767d544976-5f4w2"]
Sep 10 12:58:13.395810 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:13.395779    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" path="/var/lib/kubelet/pods/79c76b11-1cf8-4675-bdca-b012b8815248/volumes"
Sep 10 12:58:29.780625 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:29.780593    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"]
Sep 10 12:58:29.781152 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:29.780807    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy" containerID="cri-o://dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2" gracePeriod=30
Sep 10 12:58:33.799124 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:33.799038    2565 patch_prober.go:28] interesting pod/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:58:33.799124 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:33.799100    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:58:35.034392 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.034368    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:58:35.109507 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.109407    2565 generic.go:356] "Generic (PLEG): container finished" podID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerID="dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2" exitCode=0
Sep 10 12:58:35.109507 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.109492    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"
Sep 10 12:58:35.109739 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.109498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" event={"ID":"ea8468ce-b35c-4bc2-969d-e751f3675b8d","Type":"ContainerDied","Data":"dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2"}
Sep 10 12:58:35.109739 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.109567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv" event={"ID":"ea8468ce-b35c-4bc2-969d-e751f3675b8d","Type":"ContainerDied","Data":"7421eb956c10d5ed2581eb1ead4a17ba16e4ae3e493114815a99bf872abf709a"}
Sep 10 12:58:35.109739 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.109599    2565 scope.go:117] "RemoveContainer" containerID="dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2"
Sep 10 12:58:35.118939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.118924    2565 scope.go:117] "RemoveContainer" containerID="8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22"
Sep 10 12:58:35.128258 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.128238    2565 scope.go:117] "RemoveContainer" containerID="dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2"
Sep 10 12:58:35.128526 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:35.128507    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2\": container with ID starting with dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2 not found: ID does not exist" containerID="dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2"
Sep 10 12:58:35.128580 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.128535    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2"} err="failed to get container status \"dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2\": rpc error: code = NotFound desc = could not find container \"dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2\": container with ID starting with dae421b34d9c392dcbe41156a7d0f6bd7b2d72fe21cdbaae6da8e09db1119ca2 not found: ID does not exist"
Sep 10 12:58:35.128580 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.128553    2565 scope.go:117] "RemoveContainer" containerID="8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22"
Sep 10 12:58:35.128821 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:35.128803    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22\": container with ID starting with 8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22 not found: ID does not exist" containerID="8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22"
Sep 10 12:58:35.128875 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.128827    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22"} err="failed to get container status \"8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22\": rpc error: code = NotFound desc = could not find container \"8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22\": container with ID starting with 8e9b4af223bd8a9d0d5f667d4bd6fb193fa9fad33637008e9a4830131c5f3f22 not found: ID does not exist"
Sep 10 12:58:35.154329 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjswn\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-kube-api-access-wjswn\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154471 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-credential-socket\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154471 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154385    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-token\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154471 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154458    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-certs\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istiod-ca-cert\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154507    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-podinfo\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-envoy\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154570    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-data\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154631 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-socket\") pod \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\" (UID: \"ea8468ce-b35c-4bc2-969d-e751f3675b8d\") "
Sep 10 12:58:35.154875 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154681    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:35.154954 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154932    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:35.155014 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.154862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:58:35.155068 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.155039    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:35.155159 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.155137    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:35.155302 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.155285    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.155359 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.155309    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.156919 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.156854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-kube-api-access-wjswn" (OuterVolumeSpecName: "kube-api-access-wjswn") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "kube-api-access-wjswn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:35.157543 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.157502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:35.157543 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.157605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:58:35.157889 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.157731    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea8468ce-b35c-4bc2-969d-e751f3675b8d" (UID: "ea8468ce-b35c-4bc2-969d-e751f3675b8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:35.160850 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.160831    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"]
Sep 10 12:58:35.256587 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.256555    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.256587 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.256584    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.256587 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.256592    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.256831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.256600    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.256831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.256607    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea8468ce-b35c-4bc2-969d-e751f3675b8d-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.256831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.256615    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjswn\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-kube-api-access-wjswn\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.256831 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.256623    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea8468ce-b35c-4bc2-969d-e751f3675b8d-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:35.429472 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.429429    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"]
Sep 10 12:58:35.435130 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:35.435100    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b3c07b-openshift-default-74d77bdf4d-l4mpv"]
Sep 10 12:58:37.396131 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:37.396088    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" path="/var/lib/kubelet/pods/ea8468ce-b35c-4bc2-969d-e751f3675b8d/volumes"
Sep 10 12:58:41.324777 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.324728    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"]
Sep 10 12:58:41.325267 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.325044    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq" podUID="fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" containerName="maas-api" containerID="cri-o://5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be" gracePeriod=30
Sep 10 12:58:41.582313 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.582256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:58:41.619741 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.619710    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qb7m\" (UniqueName: \"kubernetes.io/projected/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-kube-api-access-6qb7m\") pod \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") "
Sep 10 12:58:41.619885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.619772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-maas-api-tls\") pod \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") "
Sep 10 12:58:41.619885 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.619796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-metrics-certs\") pod \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") "
Sep 10 12:58:41.619984 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.619907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-openshift-service-ca\") pod \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\" (UID: \"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5\") "
Sep 10 12:58:41.620389 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.620353    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" (UID: "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:58:41.622074 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.622030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" (UID: "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:58:41.622286 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.622113    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" (UID: "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:58:41.622286 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.622112    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-kube-api-access-6qb7m" (OuterVolumeSpecName: "kube-api-access-6qb7m") pod "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" (UID: "fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5"). InnerVolumeSpecName "kube-api-access-6qb7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:41.721170 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.721133    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qb7m\" (UniqueName: \"kubernetes.io/projected/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-kube-api-access-6qb7m\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:41.721170 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.721164    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:41.721170 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.721173    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:41.721433 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:41.721181    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:42.151798 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.151766    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" containerID="5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be" exitCode=0
Sep 10 12:58:42.151962 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.151817    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"
Sep 10 12:58:42.151962 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.151857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq" event={"ID":"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5","Type":"ContainerDied","Data":"5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be"}
Sep 10 12:58:42.151962 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.151916    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq" event={"ID":"fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5","Type":"ContainerDied","Data":"90fda70db727eabb37e114c8fbcfe5f4d107ef3cb632cc319c472bde69b8f476"}
Sep 10 12:58:42.151962 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.151945    2565 scope.go:117] "RemoveContainer" containerID="5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be"
Sep 10 12:58:42.162159 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.162141    2565 scope.go:117] "RemoveContainer" containerID="5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be"
Sep 10 12:58:42.162429 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:42.162412    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be\": container with ID starting with 5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be not found: ID does not exist" containerID="5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be"
Sep 10 12:58:42.162488 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.162436    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be"} err="failed to get container status \"5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be\": rpc error: code = NotFound desc = could not find container \"5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be\": container with ID starting with 5ee6f883e3f6c2c354147f577afc91bf1bcb9676a25974d91eeaa56d553702be not found: ID does not exist"
Sep 10 12:58:42.194771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.194747    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"]
Sep 10 12:58:42.205094 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:42.205070    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ac8db6-58ff7f7d57-pqgrq"]
Sep 10 12:58:43.394818 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:43.394783    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" path="/var/lib/kubelet/pods/fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5/volumes"
Sep 10 12:58:46.311775 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.311745    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"]
Sep 10 12:58:46.312146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.311943    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7" podUID="3a3acc31-ae29-41ef-9eb7-93b94646b28a" containerName="maas-api" containerID="cri-o://4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20" gracePeriod=30
Sep 10 12:58:46.571239 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.571164    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:58:46.665716 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.665677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sslpp\" (UniqueName: \"kubernetes.io/projected/3a3acc31-ae29-41ef-9eb7-93b94646b28a-kube-api-access-sslpp\") pod \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") "
Sep 10 12:58:46.665876 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.665744    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3acc31-ae29-41ef-9eb7-93b94646b28a-openshift-service-ca\") pod \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") "
Sep 10 12:58:46.665876 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.665843    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-metrics-certs\") pod \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") "
Sep 10 12:58:46.665951 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.665908    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-maas-api-tls\") pod \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\" (UID: \"3a3acc31-ae29-41ef-9eb7-93b94646b28a\") "
Sep 10 12:58:46.666198 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.666158    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a3acc31-ae29-41ef-9eb7-93b94646b28a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a3acc31-ae29-41ef-9eb7-93b94646b28a" (UID: "3a3acc31-ae29-41ef-9eb7-93b94646b28a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:58:46.668155 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.668107    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3a3acc31-ae29-41ef-9eb7-93b94646b28a" (UID: "3a3acc31-ae29-41ef-9eb7-93b94646b28a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:58:46.668288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.668192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3acc31-ae29-41ef-9eb7-93b94646b28a-kube-api-access-sslpp" (OuterVolumeSpecName: "kube-api-access-sslpp") pod "3a3acc31-ae29-41ef-9eb7-93b94646b28a" (UID: "3a3acc31-ae29-41ef-9eb7-93b94646b28a"). InnerVolumeSpecName "kube-api-access-sslpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:46.668288 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.668204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a3acc31-ae29-41ef-9eb7-93b94646b28a" (UID: "3a3acc31-ae29-41ef-9eb7-93b94646b28a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:58:46.766919 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.766885    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:46.766919 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.766911    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a3acc31-ae29-41ef-9eb7-93b94646b28a-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:46.766919 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.766922    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sslpp\" (UniqueName: \"kubernetes.io/projected/3a3acc31-ae29-41ef-9eb7-93b94646b28a-kube-api-access-sslpp\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:46.767138 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:46.766933    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a3acc31-ae29-41ef-9eb7-93b94646b28a-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:47.180495 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.180458    2565 generic.go:356] "Generic (PLEG): container finished" podID="3a3acc31-ae29-41ef-9eb7-93b94646b28a" containerID="4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20" exitCode=0
Sep 10 12:58:47.180708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.180511    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"
Sep 10 12:58:47.180708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.180537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7" event={"ID":"3a3acc31-ae29-41ef-9eb7-93b94646b28a","Type":"ContainerDied","Data":"4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20"}
Sep 10 12:58:47.180708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.180616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7" event={"ID":"3a3acc31-ae29-41ef-9eb7-93b94646b28a","Type":"ContainerDied","Data":"e50734ce8bf72a619dc4f2368607a43a3a2b2bbc1a4f98ae4c44a433f068a972"}
Sep 10 12:58:47.180708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.180649    2565 scope.go:117] "RemoveContainer" containerID="4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20"
Sep 10 12:58:47.193805 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.193786    2565 scope.go:117] "RemoveContainer" containerID="4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20"
Sep 10 12:58:47.194085 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:47.194068    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20\": container with ID starting with 4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20 not found: ID does not exist" containerID="4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20"
Sep 10 12:58:47.194146 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.194096    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20"} err="failed to get container status \"4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20\": rpc error: code = NotFound desc = could not find container \"4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20\": container with ID starting with 4b13bbdb7304ae40a126b658c4c3c8f477264430c6ac9fa36ec115d9467e6b20 not found: ID does not exist"
Sep 10 12:58:47.232680 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.232648    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"]
Sep 10 12:58:47.291848 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.291815    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-1312ea-76f4948746-8rcs7"]
Sep 10 12:58:47.394698 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:47.394660    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a3acc31-ae29-41ef-9eb7-93b94646b28a" path="/var/lib/kubelet/pods/3a3acc31-ae29-41ef-9eb7-93b94646b28a/volumes"
Sep 10 12:58:50.181025 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.180986    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p" podUID="1e4e4b72-d983-4c67-bfe3-0da7ac10353b" containerName="main" containerID="cri-o://c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5" gracePeriod=45
Sep 10 12:58:50.386610 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.386575    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"]
Sep 10 12:58:50.386887 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.386835    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy" containerID="cri-o://db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990" gracePeriod=30
Sep 10 12:58:50.445643 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.445622    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:58:50.502072 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-home\") pod \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") "
Sep 10 12:58:50.502283 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-model-cache\") pod \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") "
Sep 10 12:58:50.502283 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tmp-dir\") pod \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") "
Sep 10 12:58:50.502283 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgq4v\" (UniqueName: \"kubernetes.io/projected/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-kube-api-access-sgq4v\") pod \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") "
Sep 10 12:58:50.502443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502302    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tls-certs\") pod \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") "
Sep 10 12:58:50.502443 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502337    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-dshm\") pod \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\" (UID: \"1e4e4b72-d983-4c67-bfe3-0da7ac10353b\") "
Sep 10 12:58:50.502765 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e4e4b72-d983-4c67-bfe3-0da7ac10353b" (UID: "1e4e4b72-d983-4c67-bfe3-0da7ac10353b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:50.502914 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.502887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-home" (OuterVolumeSpecName: "home") pod "1e4e4b72-d983-4c67-bfe3-0da7ac10353b" (UID: "1e4e4b72-d983-4c67-bfe3-0da7ac10353b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:50.503039 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.503019    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e4e4b72-d983-4c67-bfe3-0da7ac10353b" (UID: "1e4e4b72-d983-4c67-bfe3-0da7ac10353b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:50.507556 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.506935    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e4e4b72-d983-4c67-bfe3-0da7ac10353b" (UID: "1e4e4b72-d983-4c67-bfe3-0da7ac10353b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:58:50.513368 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.512662    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-kube-api-access-sgq4v" (OuterVolumeSpecName: "kube-api-access-sgq4v") pod "1e4e4b72-d983-4c67-bfe3-0da7ac10353b" (UID: "1e4e4b72-d983-4c67-bfe3-0da7ac10353b"). InnerVolumeSpecName "kube-api-access-sgq4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:50.513894 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.513817    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-dshm" (OuterVolumeSpecName: "dshm") pod "1e4e4b72-d983-4c67-bfe3-0da7ac10353b" (UID: "1e4e4b72-d983-4c67-bfe3-0da7ac10353b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:50.603541 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.603510    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-home\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:50.603541 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.603538    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-model-cache\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:50.603747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.603550    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tmp-dir\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:50.603747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.603558    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgq4v\" (UniqueName: \"kubernetes.io/projected/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-kube-api-access-sgq4v\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:50.603747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.603566    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-tls-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:50.603747 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:50.603573    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e4e4b72-d983-4c67-bfe3-0da7ac10353b-dshm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:51.208132 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.208094    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e4e4b72-d983-4c67-bfe3-0da7ac10353b" containerID="c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5" exitCode=0
Sep 10 12:58:51.208132 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.208137    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"
Sep 10 12:58:51.208662 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.208163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p" event={"ID":"1e4e4b72-d983-4c67-bfe3-0da7ac10353b","Type":"ContainerDied","Data":"c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5"}
Sep 10 12:58:51.208662 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.208206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p" event={"ID":"1e4e4b72-d983-4c67-bfe3-0da7ac10353b","Type":"ContainerDied","Data":"219d61bc1132c1a88bffa54d5688a701fcdb6f58963ddbb31b21220ea9b1bcbf"}
Sep 10 12:58:51.208662 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.208251    2565 scope.go:117] "RemoveContainer" containerID="c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5"
Sep 10 12:58:51.217984 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.217968    2565 scope.go:117] "RemoveContainer" containerID="c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5"
Sep 10 12:58:51.218257 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:51.218241    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5\": container with ID starting with c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5 not found: ID does not exist" containerID="c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5"
Sep 10 12:58:51.218297 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.218266    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5"} err="failed to get container status \"c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5\": rpc error: code = NotFound desc = could not find container \"c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5\": container with ID starting with c47e63c73506e478b8c64171a32307a3601bfaa5d1322dffc1b39a0cf8f3e0b5 not found: ID does not exist"
Sep 10 12:58:51.239937 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.239909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"]
Sep 10 12:58:51.254254 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.254074    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-1312ea/unconfigured-w4-1312ea-kserve-64b59cb665-78j7p"]
Sep 10 12:58:51.395767 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:51.395732    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e4e4b72-d983-4c67-bfe3-0da7ac10353b" path="/var/lib/kubelet/pods/1e4e4b72-d983-4c67-bfe3-0da7ac10353b/volumes"
Sep 10 12:58:53.925565 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:53.925528    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"]
Sep 10 12:58:53.925978 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:53.925739    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" containerID="cri-o://e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a" gracePeriod=30
Sep 10 12:58:54.383814 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:54.383775    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:58:54.383981 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:54.383830    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:58:55.631370 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.631348    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:58:55.751609 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751574    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-socket\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.751800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-podinfo\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.751800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtdhf\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-kube-api-access-qtdhf\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.751800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-data\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.751800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f25376f6-8a68-4283-ab23-abd8eda32e82-istiod-ca-cert\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.751800 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-envoy\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.752055 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751811    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-credential-socket\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.752055 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-token\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.752055 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751893    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-certs\") pod \"f25376f6-8a68-4283-ab23-abd8eda32e82\" (UID: \"f25376f6-8a68-4283-ab23-abd8eda32e82\") "
Sep 10 12:58:55.752055 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.751893    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:55.752055 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752040    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-data" (OuterVolumeSpecName: "istio-data") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:55.752345 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752098    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f25376f6-8a68-4283-ab23-abd8eda32e82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:58:55.752345 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752132    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:55.752345 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752309    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.752345 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752326    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.752345 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752340    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.752578 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752354    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f25376f6-8a68-4283-ab23-abd8eda32e82-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.752578 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.752360    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:55.754368 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.754341    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-token" (OuterVolumeSpecName: "istio-token") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:55.754368 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.754357    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:58:55.754627 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.754602    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-kube-api-access-qtdhf" (OuterVolumeSpecName: "kube-api-access-qtdhf") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "kube-api-access-qtdhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:55.754735 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.754648    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f25376f6-8a68-4283-ab23-abd8eda32e82" (UID: "f25376f6-8a68-4283-ab23-abd8eda32e82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:55.853730 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.853697    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.853730 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.853725    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtdhf\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-kube-api-access-qtdhf\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.853730 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.853735    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.853952 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.853743    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f25376f6-8a68-4283-ab23-abd8eda32e82-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:55.853952 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:55.853750    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f25376f6-8a68-4283-ab23-abd8eda32e82-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:56.245363 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.245335    2565 generic.go:356] "Generic (PLEG): container finished" podID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerID="db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990" exitCode=0
Sep 10 12:58:56.245537 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.245392    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"
Sep 10 12:58:56.245537 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.245396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" event={"ID":"f25376f6-8a68-4283-ab23-abd8eda32e82","Type":"ContainerDied","Data":"db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990"}
Sep 10 12:58:56.245537 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.245460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc" event={"ID":"f25376f6-8a68-4283-ab23-abd8eda32e82","Type":"ContainerDied","Data":"3379276228dbe8884fbe04d4ed6ec796baf4b71aaaf6f9911e5f96714b793f81"}
Sep 10 12:58:56.245537 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.245483    2565 scope.go:117] "RemoveContainer" containerID="db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990"
Sep 10 12:58:56.255111 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.255092    2565 scope.go:117] "RemoveContainer" containerID="8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3"
Sep 10 12:58:56.263567 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.263553    2565 scope.go:117] "RemoveContainer" containerID="db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990"
Sep 10 12:58:56.263829 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:56.263812    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990\": container with ID starting with db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990 not found: ID does not exist" containerID="db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990"
Sep 10 12:58:56.263899 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.263835    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990"} err="failed to get container status \"db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990\": rpc error: code = NotFound desc = could not find container \"db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990\": container with ID starting with db531db4ff80ec4076a1cd8ad13bde75e5917c171bfdbc37ec553b4b8cc43990 not found: ID does not exist"
Sep 10 12:58:56.263899 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.263852    2565 scope.go:117] "RemoveContainer" containerID="8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3"
Sep 10 12:58:56.264057 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:56.264039    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3\": container with ID starting with 8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3 not found: ID does not exist" containerID="8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3"
Sep 10 12:58:56.264100 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.264063    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3"} err="failed to get container status \"8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3\": rpc error: code = NotFound desc = could not find container \"8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3\": container with ID starting with 8147212039a5a4b33fe38eac522667f486dacf20ce67214d7ffea006ea6faeb3 not found: ID does not exist"
Sep 10 12:58:56.274863 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.274842    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"]
Sep 10 12:58:56.281744 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:56.281719    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-ac8db6-openshift-default-ff6db8756-jkfrc"]
Sep 10 12:58:57.395246 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:57.395194    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" path="/var/lib/kubelet/pods/f25376f6-8a68-4283-ab23-abd8eda32e82/volumes"
Sep 10 12:58:59.175349 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.175323    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:58:59.264710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.264623    2565 generic.go:356] "Generic (PLEG): container finished" podID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerID="e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a" exitCode=0
Sep 10 12:58:59.264710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.264674    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"
Sep 10 12:58:59.264710 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.264691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" event={"ID":"e43df5fb-b513-46ff-bd81-71f175b43cd4","Type":"ContainerDied","Data":"e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a"}
Sep 10 12:58:59.264937 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.264745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx" event={"ID":"e43df5fb-b513-46ff-bd81-71f175b43cd4","Type":"ContainerDied","Data":"2d6957a24d69ec83760e167b121b4f7352cb062091c94ac45991c057c9330e31"}
Sep 10 12:58:59.264937 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.264775    2565 scope.go:117] "RemoveContainer" containerID="e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a"
Sep 10 12:58:59.274160 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.274141    2565 scope.go:117] "RemoveContainer" containerID="5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948"
Sep 10 12:58:59.282157 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.282136    2565 scope.go:117] "RemoveContainer" containerID="e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a"
Sep 10 12:58:59.282445 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:59.282426    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a\": container with ID starting with e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a not found: ID does not exist" containerID="e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a"
Sep 10 12:58:59.282512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.282452    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a"} err="failed to get container status \"e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a\": rpc error: code = NotFound desc = could not find container \"e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a\": container with ID starting with e5855b07372a2fd72395ab22b5af357788d17e789ef4961638e4bbee4e5d8a9a not found: ID does not exist"
Sep 10 12:58:59.282512 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.282469    2565 scope.go:117] "RemoveContainer" containerID="5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948"
Sep 10 12:58:59.282778 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:58:59.282756    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948\": container with ID starting with 5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948 not found: ID does not exist" containerID="5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948"
Sep 10 12:58:59.282843 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.282783    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948"} err="failed to get container status \"5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948\": rpc error: code = NotFound desc = could not find container \"5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948\": container with ID starting with 5783aeeb057c8bbe6124e91a4c9b8bd05ddd71e6ae6f92a761e8027d7c612948 not found: ID does not exist"
Sep 10 12:58:59.285451 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-token\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285532 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285480    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-socket\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285532 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-certs\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285706 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285547    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5bf5\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-kube-api-access-w5bf5\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285706 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-envoy\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285706 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43df5fb-b513-46ff-bd81-71f175b43cd4-istiod-ca-cert\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285859 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285724    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-podinfo\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285859 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285782    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-data\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.285966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:59.285966 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.285894    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-credential-socket\") pod \"e43df5fb-b513-46ff-bd81-71f175b43cd4\" (UID: \"e43df5fb-b513-46ff-bd81-71f175b43cd4\") "
Sep 10 12:58:59.286111 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e43df5fb-b513-46ff-bd81-71f175b43cd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:58:59.286178 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286123    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:59.286178 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286136    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:59.286465 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286444    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.286526 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286472    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.286526 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286487    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e43df5fb-b513-46ff-bd81-71f175b43cd4-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.286526 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286501    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.286526 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.286498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:59.287766 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.287743    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:59.287871 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.287848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-kube-api-access-w5bf5" (OuterVolumeSpecName: "kube-api-access-w5bf5") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "kube-api-access-w5bf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:58:59.288354 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.288329    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:58:59.288468 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.288448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e43df5fb-b513-46ff-bd81-71f175b43cd4" (UID: "e43df5fb-b513-46ff-bd81-71f175b43cd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:58:59.387128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.387095    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.387128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.387124    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.387128 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.387133    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5bf5\" (UniqueName: \"kubernetes.io/projected/e43df5fb-b513-46ff-bd81-71f175b43cd4-kube-api-access-w5bf5\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.387470 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.387142    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.387470 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.387150    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e43df5fb-b513-46ff-bd81-71f175b43cd4-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:58:59.595141 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.595057    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"]
Sep 10 12:58:59.602694 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:58:59.602668    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1312ea-openshift-default-bf594855d-h9jtx"]
Sep 10 12:59:01.360844 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.360810    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"]
Sep 10 12:59:01.361435 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.361048    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2" podUID="975fc832-c8b7-4947-922a-a2b99d963c10" containerName="maas-api" containerID="cri-o://048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31" gracePeriod=30
Sep 10 12:59:01.396426 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.396398    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" path="/var/lib/kubelet/pods/e43df5fb-b513-46ff-bd81-71f175b43cd4/volumes"
Sep 10 12:59:01.612914 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.612853    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:59:01.712861 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.712827    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/975fc832-c8b7-4947-922a-a2b99d963c10-openshift-service-ca\") pod \"975fc832-c8b7-4947-922a-a2b99d963c10\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") "
Sep 10 12:59:01.713061 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.712901    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-metrics-certs\") pod \"975fc832-c8b7-4947-922a-a2b99d963c10\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") "
Sep 10 12:59:01.713061 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.712964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-maas-api-tls\") pod \"975fc832-c8b7-4947-922a-a2b99d963c10\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") "
Sep 10 12:59:01.713061 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.712983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w2nr\" (UniqueName: \"kubernetes.io/projected/975fc832-c8b7-4947-922a-a2b99d963c10-kube-api-access-2w2nr\") pod \"975fc832-c8b7-4947-922a-a2b99d963c10\" (UID: \"975fc832-c8b7-4947-922a-a2b99d963c10\") "
Sep 10 12:59:01.713333 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.713302    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/975fc832-c8b7-4947-922a-a2b99d963c10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "975fc832-c8b7-4947-922a-a2b99d963c10" (UID: "975fc832-c8b7-4947-922a-a2b99d963c10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:59:01.715173 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.715146    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "975fc832-c8b7-4947-922a-a2b99d963c10" (UID: "975fc832-c8b7-4947-922a-a2b99d963c10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:59:01.715290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.715236    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "975fc832-c8b7-4947-922a-a2b99d963c10" (UID: "975fc832-c8b7-4947-922a-a2b99d963c10"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:59:01.715290 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.715264    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/975fc832-c8b7-4947-922a-a2b99d963c10-kube-api-access-2w2nr" (OuterVolumeSpecName: "kube-api-access-2w2nr") pod "975fc832-c8b7-4947-922a-a2b99d963c10" (UID: "975fc832-c8b7-4947-922a-a2b99d963c10"). InnerVolumeSpecName "kube-api-access-2w2nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:59:01.814659 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.814622    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:01.814659 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.814657    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/975fc832-c8b7-4947-922a-a2b99d963c10-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:01.814884 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.814670    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w2nr\" (UniqueName: \"kubernetes.io/projected/975fc832-c8b7-4947-922a-a2b99d963c10-kube-api-access-2w2nr\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:01.814884 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:01.814684    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/975fc832-c8b7-4947-922a-a2b99d963c10-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:02.284321 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.284285    2565 generic.go:356] "Generic (PLEG): container finished" podID="975fc832-c8b7-4947-922a-a2b99d963c10" containerID="048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31" exitCode=0
Sep 10 12:59:02.284533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.284341    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"
Sep 10 12:59:02.284533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.284370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2" event={"ID":"975fc832-c8b7-4947-922a-a2b99d963c10","Type":"ContainerDied","Data":"048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31"}
Sep 10 12:59:02.284533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.284427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2" event={"ID":"975fc832-c8b7-4947-922a-a2b99d963c10","Type":"ContainerDied","Data":"733ed8a6d5cd21539af8859f076355ad968da7ad17bfa7e4b72b814e2eaf18e9"}
Sep 10 12:59:02.284533 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.284449    2565 scope.go:117] "RemoveContainer" containerID="048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31"
Sep 10 12:59:02.294469 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.294447    2565 scope.go:117] "RemoveContainer" containerID="048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31"
Sep 10 12:59:02.294746 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:59:02.294730    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31\": container with ID starting with 048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31 not found: ID does not exist" containerID="048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31"
Sep 10 12:59:02.294803 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.294754    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31"} err="failed to get container status \"048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31\": rpc error: code = NotFound desc = could not find container \"048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31\": container with ID starting with 048f8cc4b5b1e5a1dc450e6d8dfc56f6f9baa85d4ce103ff70e0cf8363a14f31 not found: ID does not exist"
Sep 10 12:59:02.309602 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.309580    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"]
Sep 10 12:59:02.313771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:02.313739    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-719d8a-675855594d-kkqs2"]
Sep 10 12:59:03.395606 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:03.395565    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="975fc832-c8b7-4947-922a-a2b99d963c10" path="/var/lib/kubelet/pods/975fc832-c8b7-4947-922a-a2b99d963c10/volumes"
Sep 10 12:59:04.248991 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:04.248954    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"]
Sep 10 12:59:04.315579 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:04.315547    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"]
Sep 10 12:59:15.132704 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.132674    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"]
Sep 10 12:59:15.133203 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.132936    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg" podUID="2b01a308-459e-46ec-871f-a1c86978183e" containerName="maas-api" containerID="cri-o://37169c2e21764df2959cd703dc218aacc7b5a1672b36500fbaa21ad4de123dc6" gracePeriod=30
Sep 10 12:59:15.353378 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.353344    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b01a308-459e-46ec-871f-a1c86978183e" containerID="37169c2e21764df2959cd703dc218aacc7b5a1672b36500fbaa21ad4de123dc6" exitCode=0
Sep 10 12:59:15.353538 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.353416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg" event={"ID":"2b01a308-459e-46ec-871f-a1c86978183e","Type":"ContainerDied","Data":"37169c2e21764df2959cd703dc218aacc7b5a1672b36500fbaa21ad4de123dc6"}
Sep 10 12:59:15.382562 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.382538    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:59:15.440152 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.440062    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls\") pod \"2b01a308-459e-46ec-871f-a1c86978183e\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") "
Sep 10 12:59:15.440152 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.440111    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01a308-459e-46ec-871f-a1c86978183e-openshift-service-ca\") pod \"2b01a308-459e-46ec-871f-a1c86978183e\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") "
Sep 10 12:59:15.440730 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.440700    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b01a308-459e-46ec-871f-a1c86978183e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b01a308-459e-46ec-871f-a1c86978183e" (UID: "2b01a308-459e-46ec-871f-a1c86978183e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:59:15.441476 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.441451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-metrics-certs\") pod \"2b01a308-459e-46ec-871f-a1c86978183e\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") "
Sep 10 12:59:15.441595 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.441518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwfbh\" (UniqueName: \"kubernetes.io/projected/2b01a308-459e-46ec-871f-a1c86978183e-kube-api-access-vwfbh\") pod \"2b01a308-459e-46ec-871f-a1c86978183e\" (UID: \"2b01a308-459e-46ec-871f-a1c86978183e\") "
Sep 10 12:59:15.441939 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.441882    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b01a308-459e-46ec-871f-a1c86978183e-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:15.443430 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.443400    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b01a308-459e-46ec-871f-a1c86978183e" (UID: "2b01a308-459e-46ec-871f-a1c86978183e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:59:15.444464 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.444426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b01a308-459e-46ec-871f-a1c86978183e" (UID: "2b01a308-459e-46ec-871f-a1c86978183e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:59:15.444861 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.444813    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b01a308-459e-46ec-871f-a1c86978183e-kube-api-access-vwfbh" (OuterVolumeSpecName: "kube-api-access-vwfbh") pod "2b01a308-459e-46ec-871f-a1c86978183e" (UID: "2b01a308-459e-46ec-871f-a1c86978183e"). InnerVolumeSpecName "kube-api-access-vwfbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:59:15.543708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.543659    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:15.543708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.543697    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b01a308-459e-46ec-871f-a1c86978183e-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:15.543708 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:15.543714    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwfbh\" (UniqueName: \"kubernetes.io/projected/2b01a308-459e-46ec-871f-a1c86978183e-kube-api-access-vwfbh\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:16.360285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:16.360258    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"
Sep 10 12:59:16.360285 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:16.360265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg" event={"ID":"2b01a308-459e-46ec-871f-a1c86978183e","Type":"ContainerDied","Data":"e4f931feb6e3ede49c23428983236bea606937a1a83f74d0748684e9a9a0de82"}
Sep 10 12:59:16.360733 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:16.360326    2565 scope.go:117] "RemoveContainer" containerID="37169c2e21764df2959cd703dc218aacc7b5a1672b36500fbaa21ad4de123dc6"
Sep 10 12:59:16.391377 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:16.391353    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"]
Sep 10 12:59:16.408504 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:16.408478    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-30919a-5456488684-scxlg"]
Sep 10 12:59:17.394625 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:17.394584    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b01a308-459e-46ec-871f-a1c86978183e" path="/var/lib/kubelet/pods/2b01a308-459e-46ec-871f-a1c86978183e/volumes"
Sep 10 12:59:19.268473 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.268432    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5" podUID="f0eddc2c-93b7-4673-a769-fb3b5544e2cc" containerName="main" containerID="cri-o://5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4" gracePeriod=45
Sep 10 12:59:19.337357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.337298    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml" podUID="602869f1-8899-4830-bab9-0d9d4c320584" containerName="main" containerID="cri-o://eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856" gracePeriod=45
Sep 10 12:59:19.612364 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.612336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:59:19.615084 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.615062    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:59:19.681493 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681461    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602869f1-8899-4830-bab9-0d9d4c320584-tls-certs\") pod \"602869f1-8899-4830-bab9-0d9d4c320584\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") "
Sep 10 12:59:19.681639 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnk5n\" (UniqueName: \"kubernetes.io/projected/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-kube-api-access-tnk5n\") pod \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") "
Sep 10 12:59:19.681639 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-model-cache\") pod \"602869f1-8899-4830-bab9-0d9d4c320584\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") "
Sep 10 12:59:19.681765 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tmp-dir\") pod \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") "
Sep 10 12:59:19.681765 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681693    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-model-cache\") pod \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") "
Sep 10 12:59:19.681765 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-home\") pod \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") "
Sep 10 12:59:19.681765 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-dshm\") pod \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") "
Sep 10 12:59:19.681983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681803    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-dshm\") pod \"602869f1-8899-4830-bab9-0d9d4c320584\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") "
Sep 10 12:59:19.681983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681829    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-home\") pod \"602869f1-8899-4830-bab9-0d9d4c320584\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") "
Sep 10 12:59:19.681983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrxlf\" (UniqueName: \"kubernetes.io/projected/602869f1-8899-4830-bab9-0d9d4c320584-kube-api-access-mrxlf\") pod \"602869f1-8899-4830-bab9-0d9d4c320584\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") "
Sep 10 12:59:19.681983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681925    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tls-certs\") pod \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\" (UID: \"f0eddc2c-93b7-4673-a769-fb3b5544e2cc\") "
Sep 10 12:59:19.681983 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681949    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-tmp-dir\") pod \"602869f1-8899-4830-bab9-0d9d4c320584\" (UID: \"602869f1-8899-4830-bab9-0d9d4c320584\") "
Sep 10 12:59:19.682304 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681901    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-model-cache" (OuterVolumeSpecName: "model-cache") pod "602869f1-8899-4830-bab9-0d9d4c320584" (UID: "602869f1-8899-4830-bab9-0d9d4c320584"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.682304 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.681982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0eddc2c-93b7-4673-a769-fb3b5544e2cc" (UID: "f0eddc2c-93b7-4673-a769-fb3b5544e2cc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.682445 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.682110    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-home" (OuterVolumeSpecName: "home") pod "f0eddc2c-93b7-4673-a769-fb3b5544e2cc" (UID: "f0eddc2c-93b7-4673-a769-fb3b5544e2cc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.682445 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.682263    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0eddc2c-93b7-4673-a769-fb3b5544e2cc" (UID: "f0eddc2c-93b7-4673-a769-fb3b5544e2cc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.682553 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.682528    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-home" (OuterVolumeSpecName: "home") pod "602869f1-8899-4830-bab9-0d9d4c320584" (UID: "602869f1-8899-4830-bab9-0d9d4c320584"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.682770 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.682698    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "602869f1-8899-4830-bab9-0d9d4c320584" (UID: "602869f1-8899-4830-bab9-0d9d4c320584"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.684485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.684453    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-dshm" (OuterVolumeSpecName: "dshm") pod "602869f1-8899-4830-bab9-0d9d4c320584" (UID: "602869f1-8899-4830-bab9-0d9d4c320584"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.684485 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.684472    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-kube-api-access-tnk5n" (OuterVolumeSpecName: "kube-api-access-tnk5n") pod "f0eddc2c-93b7-4673-a769-fb3b5544e2cc" (UID: "f0eddc2c-93b7-4673-a769-fb3b5544e2cc"). InnerVolumeSpecName "kube-api-access-tnk5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:59:19.684654 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.684545    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602869f1-8899-4830-bab9-0d9d4c320584-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "602869f1-8899-4830-bab9-0d9d4c320584" (UID: "602869f1-8899-4830-bab9-0d9d4c320584"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:59:19.684900 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.684877    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-dshm" (OuterVolumeSpecName: "dshm") pod "f0eddc2c-93b7-4673-a769-fb3b5544e2cc" (UID: "f0eddc2c-93b7-4673-a769-fb3b5544e2cc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:59:19.684979 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.684962    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0eddc2c-93b7-4673-a769-fb3b5544e2cc" (UID: "f0eddc2c-93b7-4673-a769-fb3b5544e2cc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:59:19.685065 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.685042    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602869f1-8899-4830-bab9-0d9d4c320584-kube-api-access-mrxlf" (OuterVolumeSpecName: "kube-api-access-mrxlf") pod "602869f1-8899-4830-bab9-0d9d4c320584" (UID: "602869f1-8899-4830-bab9-0d9d4c320584"). InnerVolumeSpecName "kube-api-access-mrxlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:59:19.783357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783278    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-home\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783312    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-dshm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783324    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-dshm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783335    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-home\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783348    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrxlf\" (UniqueName: \"kubernetes.io/projected/602869f1-8899-4830-bab9-0d9d4c320584-kube-api-access-mrxlf\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783357 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783358    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tls-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783402    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-tmp-dir\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783412    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602869f1-8899-4830-bab9-0d9d4c320584-tls-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783421    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnk5n\" (UniqueName: \"kubernetes.io/projected/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-kube-api-access-tnk5n\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783433    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602869f1-8899-4830-bab9-0d9d4c320584-model-cache\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783446    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-tmp-dir\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:19.783771 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:19.783458    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0eddc2c-93b7-4673-a769-fb3b5544e2cc-model-cache\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 12:59:20.383470 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.383429    2565 generic.go:356] "Generic (PLEG): container finished" podID="602869f1-8899-4830-bab9-0d9d4c320584" containerID="eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856" exitCode=0
Sep 10 12:59:20.383910 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.383490    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"
Sep 10 12:59:20.383910 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.383520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml" event={"ID":"602869f1-8899-4830-bab9-0d9d4c320584","Type":"ContainerDied","Data":"eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856"}
Sep 10 12:59:20.383910 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.383568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml" event={"ID":"602869f1-8899-4830-bab9-0d9d4c320584","Type":"ContainerDied","Data":"c6554d046230c41c1e07f755acdae3da45441be2c0e3d29c09e0bc68c804d8fd"}
Sep 10 12:59:20.383910 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.383591    2565 scope.go:117] "RemoveContainer" containerID="eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856"
Sep 10 12:59:20.385089 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.385068    2565 generic.go:356] "Generic (PLEG): container finished" podID="f0eddc2c-93b7-4673-a769-fb3b5544e2cc" containerID="5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4" exitCode=0
Sep 10 12:59:20.385155 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.385106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5" event={"ID":"f0eddc2c-93b7-4673-a769-fb3b5544e2cc","Type":"ContainerDied","Data":"5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4"}
Sep 10 12:59:20.385155 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.385136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5" event={"ID":"f0eddc2c-93b7-4673-a769-fb3b5544e2cc","Type":"ContainerDied","Data":"5c491d17cc7fc5956c78182af68d072275da04d82537179d409db212e70411d7"}
Sep 10 12:59:20.385155 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.385138    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"
Sep 10 12:59:20.393410 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.393386    2565 scope.go:117] "RemoveContainer" containerID="eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856"
Sep 10 12:59:20.393690 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:59:20.393671    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856\": container with ID starting with eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856 not found: ID does not exist" containerID="eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856"
Sep 10 12:59:20.393782 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.393701    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856"} err="failed to get container status \"eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856\": rpc error: code = NotFound desc = could not find container \"eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856\": container with ID starting with eea77968784c1f95e9e7aabada23434b87d1b55e5c92486412f17a9d6be73856 not found: ID does not exist"
Sep 10 12:59:20.393782 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.393724    2565 scope.go:117] "RemoveContainer" containerID="5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4"
Sep 10 12:59:20.401838 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.401819    2565 scope.go:117] "RemoveContainer" containerID="5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4"
Sep 10 12:59:20.402109 ip-10-0-130-88 kubenswrapper[2565]: E0910 12:59:20.402091    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4\": container with ID starting with 5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4 not found: ID does not exist" containerID="5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4"
Sep 10 12:59:20.402158 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.402117    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4"} err="failed to get container status \"5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4\": rpc error: code = NotFound desc = could not find container \"5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4\": container with ID starting with 5de1d27b9f17ce929caea8090170c43e09401b06fbe5f1e0ed79b6c31fed88b4 not found: ID does not exist"
Sep 10 12:59:20.413296 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.413270    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"]
Sep 10 12:59:20.421047 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.421019    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/distinct-w0-30919a-kserve-74f59cc45b-hxtw5"]
Sep 10 12:59:20.434802 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.434773    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"]
Sep 10 12:59:20.438776 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:20.438757    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-30919a/embedding-w0-30919a-kserve-6f9789466f-68nml"]
Sep 10 12:59:21.396615 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:21.396583    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602869f1-8899-4830-bab9-0d9d4c320584" path="/var/lib/kubelet/pods/602869f1-8899-4830-bab9-0d9d4c320584/volumes"
Sep 10 12:59:21.396987 ip-10-0-130-88 kubenswrapper[2565]: I0910 12:59:21.396938    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0eddc2c-93b7-4673-a769-fb3b5544e2cc" path="/var/lib/kubelet/pods/f0eddc2c-93b7-4673-a769-fb3b5544e2cc/volumes"
Sep 10 13:01:48.372289 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372195    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7707-64ed54"]
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372532    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372543    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372551    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0eddc2c-93b7-4673-a769-fb3b5544e2cc" containerName="main"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372556    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0eddc2c-93b7-4673-a769-fb3b5544e2cc" containerName="main"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372567    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b01a308-459e-46ec-871f-a1c86978183e" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372572    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b01a308-459e-46ec-871f-a1c86978183e" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372578    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4e4b72-d983-4c67-bfe3-0da7ac10353b" containerName="main"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372583    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4e4b72-d983-4c67-bfe3-0da7ac10353b" containerName="main"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372588    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372593    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372598    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372604    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372612    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3acc31-ae29-41ef-9eb7-93b94646b28a" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372616    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3acc31-ae29-41ef-9eb7-93b94646b28a" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372625    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372630    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372636    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372641    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372646    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372651    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372661    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372666    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372671    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="975fc832-c8b7-4947-922a-a2b99d963c10" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372676    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="975fc832-c8b7-4947-922a-a2b99d963c10" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372681    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372685    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" containerName="maas-api"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372691    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602869f1-8899-4830-bab9-0d9d4c320584" containerName="main"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372695    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="602869f1-8899-4830-bab9-0d9d4c320584" containerName="main"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372742    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372748    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372755    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="602869f1-8899-4830-bab9-0d9d4c320584" containerName="main"
Sep 10 13:01:48.372746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372761    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b01a308-459e-46ec-871f-a1c86978183e" containerName="maas-api"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372766    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="975fc832-c8b7-4947-922a-a2b99d963c10" containerName="maas-api"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372773    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372777    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372781    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4e4b72-d983-4c67-bfe3-0da7ac10353b" containerName="main"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372787    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe25df0a-7dd9-4c53-a288-ffa6bc7f22d5" containerName="maas-api"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372791    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0eddc2c-93b7-4673-a769-fb3b5544e2cc" containerName="main"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372798    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3acc31-ae29-41ef-9eb7-93b94646b28a" containerName="maas-api"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372802    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f25376f6-8a68-4283-ab23-abd8eda32e82" containerName="istio-proxy"
Sep 10 13:01:48.373722 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.372806    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8468ce-b35c-4bc2-969d-e751f3675b8d" containerName="istio-proxy"
Sep 10 13:01:48.375694 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.375679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:48.378791 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.378772    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w7tsg\""
Sep 10 13:01:48.388649 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.388628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7707-64ed54"]
Sep 10 13:01:48.508420 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.508382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhqb\" (UniqueName: \"kubernetes.io/projected/a2614bb2-8e3e-4c31-a089-358ebac3f160-kube-api-access-fmhqb\") pod \"test-curl-7707-64ed54\" (UID: \"a2614bb2-8e3e-4c31-a089-358ebac3f160\") " pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:48.609740 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.609708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhqb\" (UniqueName: \"kubernetes.io/projected/a2614bb2-8e3e-4c31-a089-358ebac3f160-kube-api-access-fmhqb\") pod \"test-curl-7707-64ed54\" (UID: \"a2614bb2-8e3e-4c31-a089-358ebac3f160\") " pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:48.626650 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.626584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhqb\" (UniqueName: \"kubernetes.io/projected/a2614bb2-8e3e-4c31-a089-358ebac3f160-kube-api-access-fmhqb\") pod \"test-curl-7707-64ed54\" (UID: \"a2614bb2-8e3e-4c31-a089-358ebac3f160\") " pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:48.684348 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.684315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:48.962964 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:48.962936    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7707-64ed54"]
Sep 10 13:01:48.965172 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:01:48.965145    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2614bb2_8e3e_4c31_a089_358ebac3f160.slice/crio-a3909f038c186e93e8ba1efa65ae54ebcd27f7461827e2f908c21def9d1cdfa2 WatchSource:0}: Error finding container a3909f038c186e93e8ba1efa65ae54ebcd27f7461827e2f908c21def9d1cdfa2: Status 404 returned error can't find the container with id a3909f038c186e93e8ba1efa65ae54ebcd27f7461827e2f908c21def9d1cdfa2
Sep 10 13:01:49.133026 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:49.132989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7707-64ed54" event={"ID":"a2614bb2-8e3e-4c31-a089-358ebac3f160","Type":"ContainerStarted","Data":"56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8"}
Sep 10 13:01:49.133026 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:49.133034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7707-64ed54" event={"ID":"a2614bb2-8e3e-4c31-a089-358ebac3f160","Type":"ContainerStarted","Data":"a3909f038c186e93e8ba1efa65ae54ebcd27f7461827e2f908c21def9d1cdfa2"}
Sep 10 13:01:49.977659 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:49.977555    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7707-64ed54" podStartSLOduration=1.977538832 podStartE2EDuration="1.977538832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:01:49.160020476 +0000 UTC m=+1900.280375051" watchObservedRunningTime="2026-09-10 13:01:49.977538832 +0000 UTC m=+1901.097893409"
Sep 10 13:01:49.978031 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:49.977934    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7707-64ed54"]
Sep 10 13:01:49.991339 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:49.991307    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7707-64ed54"]
Sep 10 13:01:50.126055 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7707-939bc8"]
Sep 10 13:01:50.126349 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126336    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2614bb2-8e3e-4c31-a089-358ebac3f160" containerName="test-curl-7707-64ed54"
Sep 10 13:01:50.126394 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126351    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2614bb2-8e3e-4c31-a089-358ebac3f160" containerName="test-curl-7707-64ed54"
Sep 10 13:01:50.126394 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126369    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy"
Sep 10 13:01:50.126394 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126374    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy"
Sep 10 13:01:50.126497 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126433    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2614bb2-8e3e-4c31-a089-358ebac3f160" containerName="test-curl-7707-64ed54"
Sep 10 13:01:50.126497 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126442    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c76b11-1cf8-4675-bdca-b012b8815248" containerName="istio-proxy"
Sep 10 13:01:50.126497 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.126450    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43df5fb-b513-46ff-bd81-71f175b43cd4" containerName="istio-proxy"
Sep 10 13:01:50.129412 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.129397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:50.137845 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:50.137827    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7707-64ed54" container="test-curl-7707-64ed54"
Sep 10 13:01:50.146680 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.146653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7707-939bc8"]
Sep 10 13:01:50.221395 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.221366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnd9\" (UniqueName: \"kubernetes.io/projected/f067c858-22ef-4865-91dd-20b290c38ec0-kube-api-access-sxnd9\") pod \"test-curl-7707-939bc8\" (UID: \"f067c858-22ef-4865-91dd-20b290c38ec0\") " pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:50.321914 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.321825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnd9\" (UniqueName: \"kubernetes.io/projected/f067c858-22ef-4865-91dd-20b290c38ec0-kube-api-access-sxnd9\") pod \"test-curl-7707-939bc8\" (UID: \"f067c858-22ef-4865-91dd-20b290c38ec0\") " pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:50.333164 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.333143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnd9\" (UniqueName: \"kubernetes.io/projected/f067c858-22ef-4865-91dd-20b290c38ec0-kube-api-access-sxnd9\") pod \"test-curl-7707-939bc8\" (UID: \"f067c858-22ef-4865-91dd-20b290c38ec0\") " pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:50.438552 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.438520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:50.718406 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:50.718370    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7707-939bc8"]
Sep 10 13:01:50.722539 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:01:50.722508    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf067c858_22ef_4865_91dd_20b290c38ec0.slice/crio-53c8b2ca5ed4ee02c0bde7054e1dc7501169b11e8175a238e0fecc833978aefd WatchSource:0}: Error finding container 53c8b2ca5ed4ee02c0bde7054e1dc7501169b11e8175a238e0fecc833978aefd: Status 404 returned error can't find the container with id 53c8b2ca5ed4ee02c0bde7054e1dc7501169b11e8175a238e0fecc833978aefd
Sep 10 13:01:51.144579 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:51.144483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7707-939bc8" event={"ID":"f067c858-22ef-4865-91dd-20b290c38ec0","Type":"ContainerStarted","Data":"974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4"}
Sep 10 13:01:51.144579 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:51.144525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7707-939bc8" event={"ID":"f067c858-22ef-4865-91dd-20b290c38ec0","Type":"ContainerStarted","Data":"53c8b2ca5ed4ee02c0bde7054e1dc7501169b11e8175a238e0fecc833978aefd"}
Sep 10 13:01:51.144579 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:51.144519    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7707-64ed54" podUID="a2614bb2-8e3e-4c31-a089-358ebac3f160" containerName="test-curl-7707-64ed54" containerID="cri-o://56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8" gracePeriod=2
Sep 10 13:01:51.188590 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:51.188551    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7707-64ed54\" is forbidden: User \"system:node:ip-10-0-130-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-88.ec2.internal' and this object" podUID="a2614bb2-8e3e-4c31-a089-358ebac3f160" pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:51.192406 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:51.192376    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7707-64ed54\" is forbidden: User \"system:node:ip-10-0-130-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-88.ec2.internal' and this object" podUID="a2614bb2-8e3e-4c31-a089-358ebac3f160" pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:51.906508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:51.906399    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7707-939bc8" podStartSLOduration=1.906384233 podStartE2EDuration="1.906384233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:01:51.178371874 +0000 UTC m=+1902.298726448" watchObservedRunningTime="2026-09-10 13:01:51.906384233 +0000 UTC m=+1903.026738808"
Sep 10 13:01:51.908196 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:51.908177    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7707-939bc8"]
Sep 10 13:01:51.913934 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:51.913907    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7707-939bc8"]
Sep 10 13:01:52.148984 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:52.148953    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7707-939bc8" container="test-curl-7707-939bc8"
Sep 10 13:01:53.154128 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:53.154092    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7707-939bc8" podUID="f067c858-22ef-4865-91dd-20b290c38ec0" containerName="test-curl-7707-939bc8" containerID="cri-o://974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4" gracePeriod=2
Sep 10 13:01:53.162192 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:53.162142    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7707-939bc8\" is forbidden: User \"system:node:ip-10-0-130-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-88.ec2.internal' and this object" podUID="f067c858-22ef-4865-91dd-20b290c38ec0" pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:53.292772 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:53.292749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:53.302890 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:53.302861    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7707-939bc8\" is forbidden: User \"system:node:ip-10-0-130-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-88.ec2.internal' and this object" podUID="f067c858-22ef-4865-91dd-20b290c38ec0" pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:53.350610 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:53.350583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmhqb\" (UniqueName: \"kubernetes.io/projected/a2614bb2-8e3e-4c31-a089-358ebac3f160-kube-api-access-fmhqb\") pod \"a2614bb2-8e3e-4c31-a089-358ebac3f160\" (UID: \"a2614bb2-8e3e-4c31-a089-358ebac3f160\") "
Sep 10 13:01:53.352695 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:53.352668    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2614bb2-8e3e-4c31-a089-358ebac3f160-kube-api-access-fmhqb" (OuterVolumeSpecName: "kube-api-access-fmhqb") pod "a2614bb2-8e3e-4c31-a089-358ebac3f160" (UID: "a2614bb2-8e3e-4c31-a089-358ebac3f160"). InnerVolumeSpecName "kube-api-access-fmhqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:01:53.394338 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:53.394301    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2614bb2-8e3e-4c31-a089-358ebac3f160" path="/var/lib/kubelet/pods/a2614bb2-8e3e-4c31-a089-358ebac3f160/volumes"
Sep 10 13:01:53.452136 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:53.452104    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmhqb\" (UniqueName: \"kubernetes.io/projected/a2614bb2-8e3e-4c31-a089-358ebac3f160-kube-api-access-fmhqb\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:01:54.160130 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:54.160096    2565 generic.go:356] "Generic (PLEG): container finished" podID="a2614bb2-8e3e-4c31-a089-358ebac3f160" containerID="56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8" exitCode=137
Sep 10 13:01:54.160615 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:54.160140    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-64ed54"
Sep 10 13:01:54.160615 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:54.160167    2565 scope.go:117] "RemoveContainer" containerID="56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8"
Sep 10 13:01:54.169101 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:54.169081    2565 scope.go:117] "RemoveContainer" containerID="56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8"
Sep 10 13:01:54.169391 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:54.169370    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8\": container with ID starting with 56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8 not found: ID does not exist" containerID="56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8"
Sep 10 13:01:54.169457 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:54.169400    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8"} err="failed to get container status \"56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8\": rpc error: code = NotFound desc = could not find container \"56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8\": container with ID starting with 56c8d13335d50ed5324a43bca2c1bfcd2974c7b6c29bae822e85070cb4cca7b8 not found: ID does not exist"
Sep 10 13:01:55.336660 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:55.336636    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:55.470222 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:55.470190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxnd9\" (UniqueName: \"kubernetes.io/projected/f067c858-22ef-4865-91dd-20b290c38ec0-kube-api-access-sxnd9\") pod \"f067c858-22ef-4865-91dd-20b290c38ec0\" (UID: \"f067c858-22ef-4865-91dd-20b290c38ec0\") "
Sep 10 13:01:55.472516 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:55.472482    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f067c858-22ef-4865-91dd-20b290c38ec0-kube-api-access-sxnd9" (OuterVolumeSpecName: "kube-api-access-sxnd9") pod "f067c858-22ef-4865-91dd-20b290c38ec0" (UID: "f067c858-22ef-4865-91dd-20b290c38ec0"). InnerVolumeSpecName "kube-api-access-sxnd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:01:55.571921 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:55.571884    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxnd9\" (UniqueName: \"kubernetes.io/projected/f067c858-22ef-4865-91dd-20b290c38ec0-kube-api-access-sxnd9\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:01:56.173572 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:56.173531    2565 generic.go:356] "Generic (PLEG): container finished" podID="f067c858-22ef-4865-91dd-20b290c38ec0" containerID="974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4" exitCode=137
Sep 10 13:01:56.173789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:56.173581    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7707-939bc8"
Sep 10 13:01:56.173789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:56.173612    2565 scope.go:117] "RemoveContainer" containerID="974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4"
Sep 10 13:01:56.182449 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:56.182426    2565 scope.go:117] "RemoveContainer" containerID="974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4"
Sep 10 13:01:56.182725 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:01:56.182708    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4\": container with ID starting with 974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4 not found: ID does not exist" containerID="974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4"
Sep 10 13:01:56.182770 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:56.182734    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4"} err="failed to get container status \"974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4\": rpc error: code = NotFound desc = could not find container \"974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4\": container with ID starting with 974ac649c71f2cd0f8015a97e19ca407c7360162607cc57b57f58708522a3ae4 not found: ID does not exist"
Sep 10 13:01:57.400065 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:01:57.400023    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f067c858-22ef-4865-91dd-20b290c38ec0" path="/var/lib/kubelet/pods/f067c858-22ef-4865-91dd-20b290c38ec0/volumes"
Sep 10 13:02:00.742118 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.742083    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"]
Sep 10 13:02:00.742520 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.742450    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f067c858-22ef-4865-91dd-20b290c38ec0" containerName="test-curl-7707-939bc8"
Sep 10 13:02:00.742520 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.742468    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f067c858-22ef-4865-91dd-20b290c38ec0" containerName="test-curl-7707-939bc8"
Sep 10 13:02:00.742599 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.742539    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f067c858-22ef-4865-91dd-20b290c38ec0" containerName="test-curl-7707-939bc8"
Sep 10 13:02:00.746804 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.746788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:00.758701 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.758671    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-c5adae\"/\"rate-test-model-c5adae-kserve-self-signed-certs\""
Sep 10 13:02:00.758821 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.758683    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-c5adae\"/\"default-dockercfg-gzt7q\""
Sep 10 13:02:00.758821 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.758714    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-c5adae\"/\"kube-root-ca.crt\""
Sep 10 13:02:00.758821 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.758731    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-c5adae\"/\"openshift-service-ca.crt\""
Sep 10 13:02:00.786278 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.786249    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"]
Sep 10 13:02:00.920894 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.920859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-dshm\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:00.920894 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.920900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tls-certs\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:00.921134 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.921031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-model-cache\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:00.921134 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.921078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6ws\" (UniqueName: \"kubernetes.io/projected/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-kube-api-access-jf6ws\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:00.921134 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.921096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-home\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:00.921134 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:00.921117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tmp-dir\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-model-cache\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6ws\" (UniqueName: \"kubernetes.io/projected/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-kube-api-access-jf6ws\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-home\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022635 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tmp-dir\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022635 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-dshm\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022635 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tls-certs\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022635 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-model-cache\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022851 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-home\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.022851 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.022783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tmp-dir\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.024793 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.024766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-dshm\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.025156 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.025123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tls-certs\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.035124 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.035098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6ws\" (UniqueName: \"kubernetes.io/projected/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-kube-api-access-jf6ws\") pod \"rate-test-model-c5adae-kserve-645455667-7vxxr\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") " pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.055724 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.055695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:01.346373 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:01.346348    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"]
Sep 10 13:02:01.348191 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:02:01.348168    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67cf1cb1_7c56_4cb6_b164_1baadf5fa063.slice/crio-029d212c6b7166ab635d5ff4171c3fadd850ae594fa3d20fc79498aebfe830af WatchSource:0}: Error finding container 029d212c6b7166ab635d5ff4171c3fadd850ae594fa3d20fc79498aebfe830af: Status 404 returned error can't find the container with id 029d212c6b7166ab635d5ff4171c3fadd850ae594fa3d20fc79498aebfe830af
Sep 10 13:02:02.204896 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:02.204860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr" event={"ID":"67cf1cb1-7c56-4cb6-b164-1baadf5fa063","Type":"ContainerStarted","Data":"b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973"}
Sep 10 13:02:02.205336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:02.204904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr" event={"ID":"67cf1cb1-7c56-4cb6-b164-1baadf5fa063","Type":"ContainerStarted","Data":"029d212c6b7166ab635d5ff4171c3fadd850ae594fa3d20fc79498aebfe830af"}
Sep 10 13:02:02.239233 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:02.239163    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr" podStartSLOduration=2.239148063 podStartE2EDuration="2.239148063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:02:02.237727885 +0000 UTC m=+1913.358082465" watchObservedRunningTime="2026-09-10 13:02:02.239148063 +0000 UTC m=+1913.359502639"
Sep 10 13:02:11.056379 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:11.056337    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:11.056864 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:11.056396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:11.069257 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:11.069207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:02:11.259896 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:02:11.259856    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:03:11.749180 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:11.749147    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"]
Sep 10 13:03:13.690180 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.690145    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"]
Sep 10 13:03:13.693492 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.693476    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.696666 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.696644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-c91a45-openshift-default-dockercfg-qqpzm\""
Sep 10 13:03:13.721069 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.721042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"]
Sep 10 13:03:13.765611 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-token\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.765843 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-envoy\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.765843 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-data\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.765843 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istiod-ca-cert\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.765843 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-podinfo\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.765843 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-certs\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.765843 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-credential-socket\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.765843 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-socket\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.766264 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.765854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm52v\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-kube-api-access-bm52v\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866616 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-envoy\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866616 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-data\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866886 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istiod-ca-cert\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866886 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-podinfo\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866886 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-certs\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866886 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-credential-socket\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866886 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-socket\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866886 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm52v\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-kube-api-access-bm52v\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.866886 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.866866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-token\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.867286 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.867098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-data\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.867286 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.867144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-certs\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.867286 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.867168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-credential-socket\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.867286 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.867268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-socket\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.867501 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.867416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istiod-ca-cert\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.869352 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.869331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-envoy\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.869461 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.869332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-podinfo\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.877403 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.877375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm52v\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-kube-api-access-bm52v\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:13.878804 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:13.878782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-token\") pod \"e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") " pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:14.003181 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.003099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:14.293324 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.293256    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"]
Sep 10 13:03:14.295851 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:03:14.295810    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9915f6_9ad2_45f8_995c_4ba8dd7cfe8a.slice/crio-6558b5d438336ae09ce59a16714bf196e7a19534d418e81cdaee4b064194dc40 WatchSource:0}: Error finding container 6558b5d438336ae09ce59a16714bf196e7a19534d418e81cdaee4b064194dc40: Status 404 returned error can't find the container with id 6558b5d438336ae09ce59a16714bf196e7a19534d418e81cdaee4b064194dc40
Sep 10 13:03:14.297906 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.297871    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 13:03:14.297975 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.297940    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 13:03:14.297975 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.297967    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 13:03:14.565417 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.565319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" event={"ID":"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a","Type":"ContainerStarted","Data":"abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081"}
Sep 10 13:03:14.565417 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.565387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" event={"ID":"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a","Type":"ContainerStarted","Data":"6558b5d438336ae09ce59a16714bf196e7a19534d418e81cdaee4b064194dc40"}
Sep 10 13:03:14.596913 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:14.596864    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" podStartSLOduration=1.596844583 podStartE2EDuration="1.596844583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:03:14.596706681 +0000 UTC m=+1985.717061259" watchObservedRunningTime="2026-09-10 13:03:14.596844583 +0000 UTC m=+1985.717199159"
Sep 10 13:03:15.004069 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:15.004033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:15.009240 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:15.009198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:15.569953 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:15.569918    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:15.571055 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:15.571035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:18.722176 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.722131    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"]
Sep 10 13:03:18.725654 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.725635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.729483 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.729464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-c91a45-serving-cert\""
Sep 10 13:03:18.744702 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.744678    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"]
Sep 10 13:03:18.816149 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.816114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.816347 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.816168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29ab123-0db8-44aa-9116-3f9fa0ada169-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.816347 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.816196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc4lc\" (UniqueName: \"kubernetes.io/projected/b29ab123-0db8-44aa-9116-3f9fa0ada169-kube-api-access-bc4lc\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.816426 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.816350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-metrics-certs\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.917482 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.917448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-metrics-certs\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.917687 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.917498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.917687 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.917521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29ab123-0db8-44aa-9116-3f9fa0ada169-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.917687 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.917628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc4lc\" (UniqueName: \"kubernetes.io/projected/b29ab123-0db8-44aa-9116-3f9fa0ada169-kube-api-access-bc4lc\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.918134 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.918114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29ab123-0db8-44aa-9116-3f9fa0ada169-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.920150 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.920127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-metrics-certs\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.920314 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.920291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:18.969201 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:18.969173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc4lc\" (UniqueName: \"kubernetes.io/projected/b29ab123-0db8-44aa-9116-3f9fa0ada169-kube-api-access-bc4lc\") pod \"maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:19.036330 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:19.036248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:19.344968 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:19.344859    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"]
Sep 10 13:03:19.349300 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:03:19.349273    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29ab123_0db8_44aa_9116_3f9fa0ada169.slice/crio-567f4c557cd59e33d5b893f6f0a574fa65cfef16dd1588a45d19a775d4edc023 WatchSource:0}: Error finding container 567f4c557cd59e33d5b893f6f0a574fa65cfef16dd1588a45d19a775d4edc023: Status 404 returned error can't find the container with id 567f4c557cd59e33d5b893f6f0a574fa65cfef16dd1588a45d19a775d4edc023
Sep 10 13:03:19.350610 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:19.350592    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:03:19.589337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:19.589296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h" event={"ID":"b29ab123-0db8-44aa-9116-3f9fa0ada169","Type":"ContainerStarted","Data":"567f4c557cd59e33d5b893f6f0a574fa65cfef16dd1588a45d19a775d4edc023"}
Sep 10 13:03:21.602187 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:21.602146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h" event={"ID":"b29ab123-0db8-44aa-9116-3f9fa0ada169","Type":"ContainerStarted","Data":"a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871"}
Sep 10 13:03:21.602603 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:21.602287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:21.670144 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:21.670091    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h" podStartSLOduration=1.529828888 podStartE2EDuration="3.67007452s" totalImagesPullingTime="2.140245632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:03:21.665521192 +0000 UTC m=+1992.785875769" watchObservedRunningTime="2026-09-10 13:03:21.67007452 +0000 UTC m=+1992.790429096"
Sep 10 13:03:26.768801 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:26.768757    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr" podUID="67cf1cb1-7c56-4cb6-b164-1baadf5fa063" containerName="main" containerID="cri-o://b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973" gracePeriod=45
Sep 10 13:03:27.051099 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.051074    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tmp-dir\") pod \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") "
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tls-certs\") pod \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") "
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-dshm\") pod \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") "
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf6ws\" (UniqueName: \"kubernetes.io/projected/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-kube-api-access-jf6ws\") pod \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") "
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202331    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-model-cache\") pod \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") "
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202376    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-home\") pod \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\" (UID: \"67cf1cb1-7c56-4cb6-b164-1baadf5fa063\") "
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202837    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-home" (OuterVolumeSpecName: "home") pod "67cf1cb1-7c56-4cb6-b164-1baadf5fa063" (UID: "67cf1cb1-7c56-4cb6-b164-1baadf5fa063"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:03:27.203295 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.202983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67cf1cb1-7c56-4cb6-b164-1baadf5fa063" (UID: "67cf1cb1-7c56-4cb6-b164-1baadf5fa063"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:03:27.204098 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.204072    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-model-cache" (OuterVolumeSpecName: "model-cache") pod "67cf1cb1-7c56-4cb6-b164-1baadf5fa063" (UID: "67cf1cb1-7c56-4cb6-b164-1baadf5fa063"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:03:27.206167 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.206127    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-kube-api-access-jf6ws" (OuterVolumeSpecName: "kube-api-access-jf6ws") pod "67cf1cb1-7c56-4cb6-b164-1baadf5fa063" (UID: "67cf1cb1-7c56-4cb6-b164-1baadf5fa063"). InnerVolumeSpecName "kube-api-access-jf6ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:03:27.212537 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.212508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-dshm" (OuterVolumeSpecName: "dshm") pod "67cf1cb1-7c56-4cb6-b164-1baadf5fa063" (UID: "67cf1cb1-7c56-4cb6-b164-1baadf5fa063"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:03:27.212658 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.212623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67cf1cb1-7c56-4cb6-b164-1baadf5fa063" (UID: "67cf1cb1-7c56-4cb6-b164-1baadf5fa063"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:03:27.303411 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.303300    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-dshm\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:03:27.303411 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.303343    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf6ws\" (UniqueName: \"kubernetes.io/projected/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-kube-api-access-jf6ws\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:03:27.303411 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.303366    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-model-cache\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:03:27.303411 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.303381    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-home\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:03:27.303411 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.303394    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tmp-dir\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:03:27.303411 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.303407    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cf1cb1-7c56-4cb6-b164-1baadf5fa063-tls-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:03:27.613972 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.613880    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:03:27.633650 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.633619    2565 generic.go:356] "Generic (PLEG): container finished" podID="67cf1cb1-7c56-4cb6-b164-1baadf5fa063" containerID="b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973" exitCode=0
Sep 10 13:03:27.633817 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.633656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr" event={"ID":"67cf1cb1-7c56-4cb6-b164-1baadf5fa063","Type":"ContainerDied","Data":"b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973"}
Sep 10 13:03:27.633817 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.633664    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"
Sep 10 13:03:27.633817 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.633685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr" event={"ID":"67cf1cb1-7c56-4cb6-b164-1baadf5fa063","Type":"ContainerDied","Data":"029d212c6b7166ab635d5ff4171c3fadd850ae594fa3d20fc79498aebfe830af"}
Sep 10 13:03:27.633817 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.633703    2565 scope.go:117] "RemoveContainer" containerID="b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973"
Sep 10 13:03:27.642198 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.642177    2565 scope.go:117] "RemoveContainer" containerID="b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973"
Sep 10 13:03:27.642478 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:03:27.642456    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973\": container with ID starting with b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973 not found: ID does not exist" containerID="b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973"
Sep 10 13:03:27.642582 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.642483    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973"} err="failed to get container status \"b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973\": rpc error: code = NotFound desc = could not find container \"b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973\": container with ID starting with b75d67b8cb700f6c9b41bf49ebe30ddea1be65026c812d907b5d1932a8ad8973 not found: ID does not exist"
Sep 10 13:03:27.677861 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.677821    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"]
Sep 10 13:03:27.681096 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:27.681072    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c5adae/rate-test-model-c5adae-kserve-645455667-7vxxr"]
Sep 10 13:03:29.403828 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:29.403786    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67cf1cb1-7c56-4cb6-b164-1baadf5fa063" path="/var/lib/kubelet/pods/67cf1cb1-7c56-4cb6-b164-1baadf5fa063/volumes"
Sep 10 13:03:34.682588 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:34.682555    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerID="abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081" exitCode=0
Sep 10 13:03:34.683003 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:34.682602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" event={"ID":"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a","Type":"ContainerDied","Data":"abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081"}
Sep 10 13:03:34.683003 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:34.682953    2565 scope.go:117] "RemoveContainer" containerID="abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081"
Sep 10 13:03:34.683984 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:34.683951    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 13:03:34.684077 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:34.684020    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 13:03:34.684077 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:34.684069    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 10 13:03:35.715308 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:35.715259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" event={"ID":"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a","Type":"ContainerStarted","Data":"8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99"}
Sep 10 13:03:36.003372 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:36.003260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:36.003603 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:36.003576    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 13:03:36.003686 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:36.003649    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 13:03:37.004508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:37.004467    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 13:03:37.005128 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:37.005094    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 13:03:38.004259 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:38.004190    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 13:03:38.004941 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:38.004537    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 13:03:39.003866 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:39.003827    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 13:03:39.004158 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:39.004131    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 13:03:40.004499 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:40.004460    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 13:03:40.005103 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:40.005073    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 13:03:41.007995 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:41.007964    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:41.008386 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:41.008302    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:41.009068 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:41.009051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:03:52.790400 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.790369    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"]
Sep 10 13:03:52.790825 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.790724    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cf1cb1-7c56-4cb6-b164-1baadf5fa063" containerName="main"
Sep 10 13:03:52.790825 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.790737    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cf1cb1-7c56-4cb6-b164-1baadf5fa063" containerName="main"
Sep 10 13:03:52.790825 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.790797    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cf1cb1-7c56-4cb6-b164-1baadf5fa063" containerName="main"
Sep 10 13:03:52.793866 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.793850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.797106 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.797084    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-6ea780-serving-cert\""
Sep 10 13:03:52.823586 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.823547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"]
Sep 10 13:03:52.840299 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.840261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc44edf-4a7c-47be-a640-8514d7d295b9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.840471 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.840320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.840471 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.840447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjswg\" (UniqueName: \"kubernetes.io/projected/0cc44edf-4a7c-47be-a640-8514d7d295b9-kube-api-access-jjswg\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.840577 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.840488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-metrics-certs\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.942340 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.942284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjswg\" (UniqueName: \"kubernetes.io/projected/0cc44edf-4a7c-47be-a640-8514d7d295b9-kube-api-access-jjswg\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.942340 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.942344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-metrics-certs\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.942595 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.942412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc44edf-4a7c-47be-a640-8514d7d295b9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.942595 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.942468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.943472 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.943445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc44edf-4a7c-47be-a640-8514d7d295b9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.945314 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.945290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-metrics-certs\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.945422 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.945330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:52.989107 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:52.989071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjswg\" (UniqueName: \"kubernetes.io/projected/0cc44edf-4a7c-47be-a640-8514d7d295b9-kube-api-access-jjswg\") pod \"maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:53.104564 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:53.104472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:53.414708 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:53.414684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"]
Sep 10 13:03:53.416758 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:03:53.416731    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc44edf_4a7c_47be_a640_8514d7d295b9.slice/crio-abe56c85b3cd3eca74919d0844db1de5adf45311b4daf9c95379e2fa11837de8 WatchSource:0}: Error finding container abe56c85b3cd3eca74919d0844db1de5adf45311b4daf9c95379e2fa11837de8: Status 404 returned error can't find the container with id abe56c85b3cd3eca74919d0844db1de5adf45311b4daf9c95379e2fa11837de8
Sep 10 13:03:53.808137 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:53.808105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr" event={"ID":"0cc44edf-4a7c-47be-a640-8514d7d295b9","Type":"ContainerStarted","Data":"abe56c85b3cd3eca74919d0844db1de5adf45311b4daf9c95379e2fa11837de8"}
Sep 10 13:03:54.815081 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:54.815042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr" event={"ID":"0cc44edf-4a7c-47be-a640-8514d7d295b9","Type":"ContainerStarted","Data":"78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71"}
Sep 10 13:03:54.815615 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:54.815174    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:03:54.842331 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:03:54.842273    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr" podStartSLOduration=2.437127144 podStartE2EDuration="2.842254757s" totalImagesPullingTime="405.127613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:03:54.840144506 +0000 UTC m=+2025.960499087" watchObservedRunningTime="2026-09-10 13:03:54.842254757 +0000 UTC m=+2025.962609333"
Sep 10 13:04:00.825850 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:04:00.825815    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:05:01.732095 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.732058    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"]
Sep 10 13:05:01.735577 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.735559    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.762386 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.762354    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-c8b83b-serving-cert\""
Sep 10 13:05:01.818832 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.818797    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"]
Sep 10 13:05:01.883043 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.882995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnvdg\" (UniqueName: \"kubernetes.io/projected/5e455be9-fa25-495b-88e2-67461d14ccda-kube-api-access-dnvdg\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.883294 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.883055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.883294 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.883079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.883294 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.883148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e455be9-fa25-495b-88e2-67461d14ccda-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.983956 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.983866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.983956 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.983910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.983956 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.983952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e455be9-fa25-495b-88e2-67461d14ccda-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.984189 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.984025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnvdg\" (UniqueName: \"kubernetes.io/projected/5e455be9-fa25-495b-88e2-67461d14ccda-kube-api-access-dnvdg\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.984782 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.984702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e455be9-fa25-495b-88e2-67461d14ccda-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.986561 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.986535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:01.986746 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:01.986727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:02.033736 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:02.033707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnvdg\" (UniqueName: \"kubernetes.io/projected/5e455be9-fa25-495b-88e2-67461d14ccda-kube-api-access-dnvdg\") pod \"maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:02.047633 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:02.047601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:02.419014 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:02.418918    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"]
Sep 10 13:05:02.423258 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:05:02.423201    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e455be9_fa25_495b_88e2_67461d14ccda.slice/crio-b8acc7ad515f467d1343bd4a446594c3b4fb1ff4fab9fc07595e15672ae22f54 WatchSource:0}: Error finding container b8acc7ad515f467d1343bd4a446594c3b4fb1ff4fab9fc07595e15672ae22f54: Status 404 returned error can't find the container with id b8acc7ad515f467d1343bd4a446594c3b4fb1ff4fab9fc07595e15672ae22f54
Sep 10 13:05:03.169566 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:03.169530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf" event={"ID":"5e455be9-fa25-495b-88e2-67461d14ccda","Type":"ContainerStarted","Data":"b8acc7ad515f467d1343bd4a446594c3b4fb1ff4fab9fc07595e15672ae22f54"}
Sep 10 13:05:04.182301 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:04.182265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf" event={"ID":"5e455be9-fa25-495b-88e2-67461d14ccda","Type":"ContainerStarted","Data":"14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd"}
Sep 10 13:05:04.182720 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:04.182392    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:10.193316 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:10.193283    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:10.268671 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:10.268611    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf" podStartSLOduration=8.484191298 podStartE2EDuration="9.268594903s" totalImagesPullingTime="784.403605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:05:04.255578602 +0000 UTC m=+2095.375933180" watchObservedRunningTime="2026-09-10 13:05:10.268594903 +0000 UTC m=+2101.388949535"
Sep 10 13:05:43.971687 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:43.971646    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"]
Sep 10 13:05:43.972273 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:43.971899    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf" podUID="5e455be9-fa25-495b-88e2-67461d14ccda" containerName="maas-api" containerID="cri-o://14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd" gracePeriod=30
Sep 10 13:05:44.225521 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.225460    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:44.380504 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.380470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-metrics-certs\") pod \"5e455be9-fa25-495b-88e2-67461d14ccda\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") "
Sep 10 13:05:44.380672 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.380528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e455be9-fa25-495b-88e2-67461d14ccda-openshift-service-ca\") pod \"5e455be9-fa25-495b-88e2-67461d14ccda\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") "
Sep 10 13:05:44.380672 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.380556    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-maas-api-tls\") pod \"5e455be9-fa25-495b-88e2-67461d14ccda\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") "
Sep 10 13:05:44.380672 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.380575    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnvdg\" (UniqueName: \"kubernetes.io/projected/5e455be9-fa25-495b-88e2-67461d14ccda-kube-api-access-dnvdg\") pod \"5e455be9-fa25-495b-88e2-67461d14ccda\" (UID: \"5e455be9-fa25-495b-88e2-67461d14ccda\") "
Sep 10 13:05:44.380930 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.380900    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e455be9-fa25-495b-88e2-67461d14ccda-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5e455be9-fa25-495b-88e2-67461d14ccda" (UID: "5e455be9-fa25-495b-88e2-67461d14ccda"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:05:44.382841 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.382807    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5e455be9-fa25-495b-88e2-67461d14ccda" (UID: "5e455be9-fa25-495b-88e2-67461d14ccda"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:05:44.382947 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.382834    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e455be9-fa25-495b-88e2-67461d14ccda-kube-api-access-dnvdg" (OuterVolumeSpecName: "kube-api-access-dnvdg") pod "5e455be9-fa25-495b-88e2-67461d14ccda" (UID: "5e455be9-fa25-495b-88e2-67461d14ccda"). InnerVolumeSpecName "kube-api-access-dnvdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:05:44.382947 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.382844    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5e455be9-fa25-495b-88e2-67461d14ccda" (UID: "5e455be9-fa25-495b-88e2-67461d14ccda"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:05:44.388978 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.388690    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e455be9-fa25-495b-88e2-67461d14ccda" containerID="14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd" exitCode=0
Sep 10 13:05:44.388978 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.388728    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"
Sep 10 13:05:44.388978 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.388773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf" event={"ID":"5e455be9-fa25-495b-88e2-67461d14ccda","Type":"ContainerDied","Data":"14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd"}
Sep 10 13:05:44.388978 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.388829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf" event={"ID":"5e455be9-fa25-495b-88e2-67461d14ccda","Type":"ContainerDied","Data":"b8acc7ad515f467d1343bd4a446594c3b4fb1ff4fab9fc07595e15672ae22f54"}
Sep 10 13:05:44.388978 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.388859    2565 scope.go:117] "RemoveContainer" containerID="14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd"
Sep 10 13:05:44.401838 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.401815    2565 scope.go:117] "RemoveContainer" containerID="14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd"
Sep 10 13:05:44.402104 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:05:44.402086    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd\": container with ID starting with 14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd not found: ID does not exist" containerID="14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd"
Sep 10 13:05:44.402160 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.402113    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd"} err="failed to get container status \"14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd\": rpc error: code = NotFound desc = could not find container \"14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd\": container with ID starting with 14d8b66560abe52cdeea7415b0902a23f42ae01358dfd0b3d85fb783af2dacfd not found: ID does not exist"
Sep 10 13:05:44.443496 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.443462    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"]
Sep 10 13:05:44.456226 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.456186    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c8b83b-787b5b45df-skqcf"]
Sep 10 13:05:44.482144 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.482056    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:05:44.482144 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.482094    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e455be9-fa25-495b-88e2-67461d14ccda-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:05:44.482144 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.482111    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e455be9-fa25-495b-88e2-67461d14ccda-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:05:44.482144 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:44.482126    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnvdg\" (UniqueName: \"kubernetes.io/projected/5e455be9-fa25-495b-88e2-67461d14ccda-kube-api-access-dnvdg\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:05:45.396069 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:05:45.396036    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e455be9-fa25-495b-88e2-67461d14ccda" path="/var/lib/kubelet/pods/5e455be9-fa25-495b-88e2-67461d14ccda/volumes"
Sep 10 13:06:12.782323 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:12.782287    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"]
Sep 10 13:06:12.782771 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:12.782538    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h" podUID="b29ab123-0db8-44aa-9116-3f9fa0ada169" containerName="maas-api" containerID="cri-o://a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871" gracePeriod=30
Sep 10 13:06:13.036992 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.036929    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:06:13.132179 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.132145    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29ab123-0db8-44aa-9116-3f9fa0ada169-openshift-service-ca\") pod \"b29ab123-0db8-44aa-9116-3f9fa0ada169\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") "
Sep 10 13:06:13.132395 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.132232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc4lc\" (UniqueName: \"kubernetes.io/projected/b29ab123-0db8-44aa-9116-3f9fa0ada169-kube-api-access-bc4lc\") pod \"b29ab123-0db8-44aa-9116-3f9fa0ada169\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") "
Sep 10 13:06:13.132395 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.132256    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-metrics-certs\") pod \"b29ab123-0db8-44aa-9116-3f9fa0ada169\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") "
Sep 10 13:06:13.132395 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.132310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-maas-api-tls\") pod \"b29ab123-0db8-44aa-9116-3f9fa0ada169\" (UID: \"b29ab123-0db8-44aa-9116-3f9fa0ada169\") "
Sep 10 13:06:13.132616 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.132591    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29ab123-0db8-44aa-9116-3f9fa0ada169-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b29ab123-0db8-44aa-9116-3f9fa0ada169" (UID: "b29ab123-0db8-44aa-9116-3f9fa0ada169"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:06:13.134516 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.134488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b29ab123-0db8-44aa-9116-3f9fa0ada169" (UID: "b29ab123-0db8-44aa-9116-3f9fa0ada169"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:06:13.134621 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.134530    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b29ab123-0db8-44aa-9116-3f9fa0ada169" (UID: "b29ab123-0db8-44aa-9116-3f9fa0ada169"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:06:13.134621 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.134562    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29ab123-0db8-44aa-9116-3f9fa0ada169-kube-api-access-bc4lc" (OuterVolumeSpecName: "kube-api-access-bc4lc") pod "b29ab123-0db8-44aa-9116-3f9fa0ada169" (UID: "b29ab123-0db8-44aa-9116-3f9fa0ada169"). InnerVolumeSpecName "kube-api-access-bc4lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:06:13.233764 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.233732    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc4lc\" (UniqueName: \"kubernetes.io/projected/b29ab123-0db8-44aa-9116-3f9fa0ada169-kube-api-access-bc4lc\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:06:13.233764 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.233763    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:06:13.233982 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.233775    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29ab123-0db8-44aa-9116-3f9fa0ada169-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:06:13.233982 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.233786    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29ab123-0db8-44aa-9116-3f9fa0ada169-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:06:13.545284 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.545251    2565 generic.go:356] "Generic (PLEG): container finished" podID="b29ab123-0db8-44aa-9116-3f9fa0ada169" containerID="a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871" exitCode=0
Sep 10 13:06:13.545458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.545295    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"
Sep 10 13:06:13.545458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.545309    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h" event={"ID":"b29ab123-0db8-44aa-9116-3f9fa0ada169","Type":"ContainerDied","Data":"a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871"}
Sep 10 13:06:13.545458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.545352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h" event={"ID":"b29ab123-0db8-44aa-9116-3f9fa0ada169","Type":"ContainerDied","Data":"567f4c557cd59e33d5b893f6f0a574fa65cfef16dd1588a45d19a775d4edc023"}
Sep 10 13:06:13.545458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.545376    2565 scope.go:117] "RemoveContainer" containerID="a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871"
Sep 10 13:06:13.554463 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.554446    2565 scope.go:117] "RemoveContainer" containerID="a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871"
Sep 10 13:06:13.554752 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:06:13.554732    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871\": container with ID starting with a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871 not found: ID does not exist" containerID="a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871"
Sep 10 13:06:13.554854 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.554760    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871"} err="failed to get container status \"a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871\": rpc error: code = NotFound desc = could not find container \"a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871\": container with ID starting with a4c0be71548e5e26ab3bcd624883c849d5865b177d6fb7aad15eae621aec3871 not found: ID does not exist"
Sep 10 13:06:13.569068 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.569042    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"]
Sep 10 13:06:13.574676 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:13.574653    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c91a45-678bf5b745-2kq8h"]
Sep 10 13:06:15.396165 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:06:15.396130    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29ab123-0db8-44aa-9116-3f9fa0ada169" path="/var/lib/kubelet/pods/b29ab123-0db8-44aa-9116-3f9fa0ada169/volumes"
Sep 10 13:07:17.281666 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:17.281629    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"]
Sep 10 13:07:17.282199 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:17.281868    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy" containerID="cri-o://8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99" gracePeriod=30
Sep 10 13:07:22.540940 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.540912    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:07:22.665495 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-token\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665495 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-credential-socket\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665495 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665497    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-envoy\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665899 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm52v\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-kube-api-access-bm52v\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665899 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665546    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-data\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665899 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istiod-ca-cert\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665899 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665639    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-socket\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665899 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-certs\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665899 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-podinfo\") pod \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\" (UID: \"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a\") "
Sep 10 13:07:22.665899 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.665937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.666009    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.666101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.666130    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.666225    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.666246    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.666259    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.666337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.666270    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.667877 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.667856    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:07:22.667963 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.667918    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:07:22.668435 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.668415    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 13:07:22.668435 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.668417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-kube-api-access-bm52v" (OuterVolumeSpecName: "kube-api-access-bm52v") pod "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" (UID: "eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a"). InnerVolumeSpecName "kube-api-access-bm52v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:07:22.767472 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.767436    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.767472 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.767465    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.767472 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.767473    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.767472 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.767482    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.767736 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.767490    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm52v\" (UniqueName: \"kubernetes.io/projected/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a-kube-api-access-bm52v\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:22.893624 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.893589    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerID="8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99" exitCode=0
Sep 10 13:07:22.893789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.893640    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"
Sep 10 13:07:22.893789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.893671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" event={"ID":"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a","Type":"ContainerDied","Data":"8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99"}
Sep 10 13:07:22.893789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.893755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg" event={"ID":"eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a","Type":"ContainerDied","Data":"6558b5d438336ae09ce59a16714bf196e7a19534d418e81cdaee4b064194dc40"}
Sep 10 13:07:22.893789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.893779    2565 scope.go:117] "RemoveContainer" containerID="8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99"
Sep 10 13:07:22.903618 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.903601    2565 scope.go:117] "RemoveContainer" containerID="abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081"
Sep 10 13:07:22.911487 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.911469    2565 scope.go:117] "RemoveContainer" containerID="8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99"
Sep 10 13:07:22.911797 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:07:22.911780    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99\": container with ID starting with 8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99 not found: ID does not exist" containerID="8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99"
Sep 10 13:07:22.911850 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.911806    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99"} err="failed to get container status \"8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99\": rpc error: code = NotFound desc = could not find container \"8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99\": container with ID starting with 8c561037664630749e3118cfd5ec4dca66da7576f7107266ace6f46fd101bd99 not found: ID does not exist"
Sep 10 13:07:22.911850 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.911823    2565 scope.go:117] "RemoveContainer" containerID="abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081"
Sep 10 13:07:22.912088 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:07:22.912072    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081\": container with ID starting with abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081 not found: ID does not exist" containerID="abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081"
Sep 10 13:07:22.912133 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.912094    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081"} err="failed to get container status \"abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081\": rpc error: code = NotFound desc = could not find container \"abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081\": container with ID starting with abf0099c83702598983553fdf4fab2ae01493fc682b9da76c8ab998861951081 not found: ID does not exist"
Sep 10 13:07:22.921667 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.921618    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"]
Sep 10 13:07:22.930238 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:22.930203    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-c91a45-openshift-default-849bfb68cb-cmwvg"]
Sep 10 13:07:23.394970 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:23.394925    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" path="/var/lib/kubelet/pods/eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a/volumes"
Sep 10 13:07:28.358803 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.358766    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"]
Sep 10 13:07:28.359229 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.358966    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr" podUID="0cc44edf-4a7c-47be-a640-8514d7d295b9" containerName="maas-api" containerID="cri-o://78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71" gracePeriod=30
Sep 10 13:07:28.600790 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.600748    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:07:28.718435 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.718399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-metrics-certs\") pod \"0cc44edf-4a7c-47be-a640-8514d7d295b9\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") "
Sep 10 13:07:28.718652 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.718454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-maas-api-tls\") pod \"0cc44edf-4a7c-47be-a640-8514d7d295b9\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") "
Sep 10 13:07:28.718652 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.718488    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjswg\" (UniqueName: \"kubernetes.io/projected/0cc44edf-4a7c-47be-a640-8514d7d295b9-kube-api-access-jjswg\") pod \"0cc44edf-4a7c-47be-a640-8514d7d295b9\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") "
Sep 10 13:07:28.718652 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.718512    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc44edf-4a7c-47be-a640-8514d7d295b9-openshift-service-ca\") pod \"0cc44edf-4a7c-47be-a640-8514d7d295b9\" (UID: \"0cc44edf-4a7c-47be-a640-8514d7d295b9\") "
Sep 10 13:07:28.718947 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.718921    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cc44edf-4a7c-47be-a640-8514d7d295b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0cc44edf-4a7c-47be-a640-8514d7d295b9" (UID: "0cc44edf-4a7c-47be-a640-8514d7d295b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:07:28.720804 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.720778    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0cc44edf-4a7c-47be-a640-8514d7d295b9" (UID: "0cc44edf-4a7c-47be-a640-8514d7d295b9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:07:28.720948 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.720925    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0cc44edf-4a7c-47be-a640-8514d7d295b9" (UID: "0cc44edf-4a7c-47be-a640-8514d7d295b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:07:28.721037 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.721020    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc44edf-4a7c-47be-a640-8514d7d295b9-kube-api-access-jjswg" (OuterVolumeSpecName: "kube-api-access-jjswg") pod "0cc44edf-4a7c-47be-a640-8514d7d295b9" (UID: "0cc44edf-4a7c-47be-a640-8514d7d295b9"). InnerVolumeSpecName "kube-api-access-jjswg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:07:28.819604 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.819566    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:28.819604 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.819598    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cc44edf-4a7c-47be-a640-8514d7d295b9-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:28.819604 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.819607    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjswg\" (UniqueName: \"kubernetes.io/projected/0cc44edf-4a7c-47be-a640-8514d7d295b9-kube-api-access-jjswg\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:28.819854 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.819616    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cc44edf-4a7c-47be-a640-8514d7d295b9-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:28.927139 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.927106    2565 generic.go:356] "Generic (PLEG): container finished" podID="0cc44edf-4a7c-47be-a640-8514d7d295b9" containerID="78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71" exitCode=0
Sep 10 13:07:28.927336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.927158    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"
Sep 10 13:07:28.927336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.927195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr" event={"ID":"0cc44edf-4a7c-47be-a640-8514d7d295b9","Type":"ContainerDied","Data":"78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71"}
Sep 10 13:07:28.927336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.927267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr" event={"ID":"0cc44edf-4a7c-47be-a640-8514d7d295b9","Type":"ContainerDied","Data":"abe56c85b3cd3eca74919d0844db1de5adf45311b4daf9c95379e2fa11837de8"}
Sep 10 13:07:28.927336 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.927297    2565 scope.go:117] "RemoveContainer" containerID="78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71"
Sep 10 13:07:28.936731 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.936708    2565 scope.go:117] "RemoveContainer" containerID="78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71"
Sep 10 13:07:28.937014 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:07:28.936996    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71\": container with ID starting with 78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71 not found: ID does not exist" containerID="78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71"
Sep 10 13:07:28.937066 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.937024    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71"} err="failed to get container status \"78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71\": rpc error: code = NotFound desc = could not find container \"78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71\": container with ID starting with 78ac3eaf5d10e88d4b30d04e54c3ea5fe13918fd54af1441d69bf671e7591b71 not found: ID does not exist"
Sep 10 13:07:28.954619 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.954585    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"]
Sep 10 13:07:28.958943 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:28.958918    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6ea780-bcdbd7fb8-m4ttr"]
Sep 10 13:07:29.396309 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:29.396276    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc44edf-4a7c-47be-a640-8514d7d295b9" path="/var/lib/kubelet/pods/0cc44edf-4a7c-47be-a640-8514d7d295b9/volumes"
Sep 10 13:07:47.387979 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.387898    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"]
Sep 10 13:07:47.388482 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.388107    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" podUID="af559125-b33d-4b9c-b892-26013a9f1716" containerName="maas-api" containerID="cri-o://d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6" gracePeriod=30
Sep 10 13:07:47.641155 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.641098    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 13:07:47.683117 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.683088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-metrics-certs\") pod \"af559125-b33d-4b9c-b892-26013a9f1716\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") "
Sep 10 13:07:47.683299 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.683132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls\") pod \"af559125-b33d-4b9c-b892-26013a9f1716\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") "
Sep 10 13:07:47.683299 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.683249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9bzx\" (UniqueName: \"kubernetes.io/projected/af559125-b33d-4b9c-b892-26013a9f1716-kube-api-access-p9bzx\") pod \"af559125-b33d-4b9c-b892-26013a9f1716\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") "
Sep 10 13:07:47.683441 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.683300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af559125-b33d-4b9c-b892-26013a9f1716-openshift-service-ca\") pod \"af559125-b33d-4b9c-b892-26013a9f1716\" (UID: \"af559125-b33d-4b9c-b892-26013a9f1716\") "
Sep 10 13:07:47.683768 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.683736    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af559125-b33d-4b9c-b892-26013a9f1716-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af559125-b33d-4b9c-b892-26013a9f1716" (UID: "af559125-b33d-4b9c-b892-26013a9f1716"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:07:47.685626 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.685594    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af559125-b33d-4b9c-b892-26013a9f1716-kube-api-access-p9bzx" (OuterVolumeSpecName: "kube-api-access-p9bzx") pod "af559125-b33d-4b9c-b892-26013a9f1716" (UID: "af559125-b33d-4b9c-b892-26013a9f1716"). InnerVolumeSpecName "kube-api-access-p9bzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:07:47.685896 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.685869    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af559125-b33d-4b9c-b892-26013a9f1716" (UID: "af559125-b33d-4b9c-b892-26013a9f1716"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:07:47.686007 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.685986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "af559125-b33d-4b9c-b892-26013a9f1716" (UID: "af559125-b33d-4b9c-b892-26013a9f1716"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:07:47.784623 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.784594    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:47.784623 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.784621    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af559125-b33d-4b9c-b892-26013a9f1716-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:47.784866 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.784630    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9bzx\" (UniqueName: \"kubernetes.io/projected/af559125-b33d-4b9c-b892-26013a9f1716-kube-api-access-p9bzx\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:47.784866 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:47.784641    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af559125-b33d-4b9c-b892-26013a9f1716-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:07:48.028583 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.028545    2565 generic.go:356] "Generic (PLEG): container finished" podID="af559125-b33d-4b9c-b892-26013a9f1716" containerID="d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6" exitCode=0
Sep 10 13:07:48.028798 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.028610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" event={"ID":"af559125-b33d-4b9c-b892-26013a9f1716","Type":"ContainerDied","Data":"d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6"}
Sep 10 13:07:48.028798 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.028668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" event={"ID":"af559125-b33d-4b9c-b892-26013a9f1716","Type":"ContainerDied","Data":"bc6233d63a7a209b1a95bc4ea50a5292c4f42c6c3c9ce19c6159b88537854373"}
Sep 10 13:07:48.028798 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.028697    2565 scope.go:117] "RemoveContainer" containerID="d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6"
Sep 10 13:07:48.028798 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.028717    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"
Sep 10 13:07:48.039873 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.039853    2565 scope.go:117] "RemoveContainer" containerID="d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6"
Sep 10 13:07:48.040175 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:07:48.040153    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6\": container with ID starting with d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6 not found: ID does not exist" containerID="d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6"
Sep 10 13:07:48.040278 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.040182    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6"} err="failed to get container status \"d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6\": rpc error: code = NotFound desc = could not find container \"d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6\": container with ID starting with d2816b0d74dd03a0d438a1d24b3fd6f35edfb56aeed334a299be3951925712c6 not found: ID does not exist"
Sep 10 13:07:48.053714 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.053688    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"]
Sep 10 13:07:48.059961 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:48.059937    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr"]
Sep 10 13:07:49.394609 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:49.394578    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af559125-b33d-4b9c-b892-26013a9f1716" path="/var/lib/kubelet/pods/af559125-b33d-4b9c-b892-26013a9f1716/volumes"
Sep 10 13:07:50.620904 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:50.620837    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c5adae-6b7959f658-b9qnr" podUID="af559125-b33d-4b9c-b892-26013a9f1716" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.60:8443/health\": context deadline exceeded"
Sep 10 13:07:56.457911 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:56.457879    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"]
Sep 10 13:07:56.458466 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:07:56.458076    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy" containerID="cri-o://1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040" gracePeriod=30
Sep 10 13:08:01.704340 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.704312    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 13:08:01.807123 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807029    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-credential-socket\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807123 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-data\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807123 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807089    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp5dw\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-kube-api-access-hp5dw\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807123 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cda6db8-8074-428d-a189-4b600f34382b-istiod-ca-cert\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807147    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-envoy\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-certs\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807256    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cda6db8-8074-428d-a189-4b600f34382b-istio-podinfo\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807302    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-socket\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-istio-token\") pod \"5cda6db8-8074-428d-a189-4b600f34382b\" (UID: \"5cda6db8-8074-428d-a189-4b600f34382b\") "
Sep 10 13:08:01.807508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807411    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:08:01.807508 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807432    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:08:01.807844 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807680    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-credential-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.807844 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807699    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-data\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.807844 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:08:01.807844 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807830    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:08:01.808230 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.807810    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cda6db8-8074-428d-a189-4b600f34382b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:08:01.809664 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.809634    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 13:08:01.809664 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.809652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:08:01.809811 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.809643    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-kube-api-access-hp5dw" (OuterVolumeSpecName: "kube-api-access-hp5dw") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "kube-api-access-hp5dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:08:01.809811 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.809739    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5cda6db8-8074-428d-a189-4b600f34382b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5cda6db8-8074-428d-a189-4b600f34382b" (UID: "5cda6db8-8074-428d-a189-4b600f34382b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 13:08:01.908458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.908418    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp5dw\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-kube-api-access-hp5dw\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.908458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.908451    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cda6db8-8074-428d-a189-4b600f34382b-istiod-ca-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.908458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.908461    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-istio-envoy\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.908458 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.908469    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.908734 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.908477    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cda6db8-8074-428d-a189-4b600f34382b-istio-podinfo\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.908734 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.908484    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cda6db8-8074-428d-a189-4b600f34382b-workload-socket\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:01.908734 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:01.908492    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cda6db8-8074-428d-a189-4b600f34382b-istio-token\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:02.100151 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.100067    2565 generic.go:356] "Generic (PLEG): container finished" podID="5cda6db8-8074-428d-a189-4b600f34382b" containerID="1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040" exitCode=0
Sep 10 13:08:02.100151 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.100104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" event={"ID":"5cda6db8-8074-428d-a189-4b600f34382b","Type":"ContainerDied","Data":"1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040"}
Sep 10 13:08:02.100151 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.100118    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"
Sep 10 13:08:02.100151 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.100148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t" event={"ID":"5cda6db8-8074-428d-a189-4b600f34382b","Type":"ContainerDied","Data":"01d5d20ab0fb05c926e7e3111f643e8cea92a7257fc9d2a328f41e8a73f3176d"}
Sep 10 13:08:02.100497 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.100171    2565 scope.go:117] "RemoveContainer" containerID="1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040"
Sep 10 13:08:02.109933 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.109907    2565 scope.go:117] "RemoveContainer" containerID="2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e"
Sep 10 13:08:02.118354 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.118334    2565 scope.go:117] "RemoveContainer" containerID="1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040"
Sep 10 13:08:02.118622 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:08:02.118603    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040\": container with ID starting with 1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040 not found: ID does not exist" containerID="1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040"
Sep 10 13:08:02.118671 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.118631    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040"} err="failed to get container status \"1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040\": rpc error: code = NotFound desc = could not find container \"1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040\": container with ID starting with 1858799defe79b8e8a1aecbe73ebc79330857294c167385e8529474c221f8040 not found: ID does not exist"
Sep 10 13:08:02.118671 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.118649    2565 scope.go:117] "RemoveContainer" containerID="2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e"
Sep 10 13:08:02.118926 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:08:02.118907    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e\": container with ID starting with 2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e not found: ID does not exist" containerID="2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e"
Sep 10 13:08:02.118984 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.118931    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e"} err="failed to get container status \"2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e\": rpc error: code = NotFound desc = could not find container \"2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e\": container with ID starting with 2e62e634497847a261fa8aa58ec969589ba98d937f5f3f59cdb19cb8d97f2f0e not found: ID does not exist"
Sep 10 13:08:02.129789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.129763    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"]
Sep 10 13:08:02.139952 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:02.139930    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c5adae-openshift-default-74b6dc5d46-6td7t"]
Sep 10 13:08:03.394307 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:03.394279    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cda6db8-8074-428d-a189-4b600f34382b" path="/var/lib/kubelet/pods/5cda6db8-8074-428d-a189-4b600f34382b/volumes"
Sep 10 13:08:17.976398 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:17.976359    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-r26xr"]
Sep 10 13:08:17.976846 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:17.976586    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr" podUID="08f65fcb-3b37-4fd6-9fb6-88ee1c000420" containerName="manager" containerID="cri-o://b7a9cc8743f0c6eee8d0a799ea96aee55625041eaac7a7086ab1e759f600e6fd" gracePeriod=30
Sep 10 13:08:18.177048 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.177016    2565 generic.go:356] "Generic (PLEG): container finished" podID="08f65fcb-3b37-4fd6-9fb6-88ee1c000420" containerID="b7a9cc8743f0c6eee8d0a799ea96aee55625041eaac7a7086ab1e759f600e6fd" exitCode=0
Sep 10 13:08:18.177048 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.177054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr" event={"ID":"08f65fcb-3b37-4fd6-9fb6-88ee1c000420","Type":"ContainerDied","Data":"b7a9cc8743f0c6eee8d0a799ea96aee55625041eaac7a7086ab1e759f600e6fd"}
Sep 10 13:08:18.221546 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.221518    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 13:08:18.348069 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.347991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-webhook-cert\") pod \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") "
Sep 10 13:08:18.348069 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.348054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgrj2\" (UniqueName: \"kubernetes.io/projected/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-kube-api-access-kgrj2\") pod \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") "
Sep 10 13:08:18.348355 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.348088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-metrics-certs\") pod \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\" (UID: \"08f65fcb-3b37-4fd6-9fb6-88ee1c000420\") "
Sep 10 13:08:18.350325 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.350283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-kube-api-access-kgrj2" (OuterVolumeSpecName: "kube-api-access-kgrj2") pod "08f65fcb-3b37-4fd6-9fb6-88ee1c000420" (UID: "08f65fcb-3b37-4fd6-9fb6-88ee1c000420"). InnerVolumeSpecName "kube-api-access-kgrj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:08:18.350429 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.350341    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "08f65fcb-3b37-4fd6-9fb6-88ee1c000420" (UID: "08f65fcb-3b37-4fd6-9fb6-88ee1c000420"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:08:18.350429 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.350362    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "08f65fcb-3b37-4fd6-9fb6-88ee1c000420" (UID: "08f65fcb-3b37-4fd6-9fb6-88ee1c000420"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:08:18.449597 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.449562    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-webhook-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:18.449597 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.449591    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgrj2\" (UniqueName: \"kubernetes.io/projected/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-kube-api-access-kgrj2\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:18.449597 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:18.449600    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08f65fcb-3b37-4fd6-9fb6-88ee1c000420-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:08:19.183781 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:19.183751    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr"
Sep 10 13:08:19.184263 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:19.183750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-r26xr" event={"ID":"08f65fcb-3b37-4fd6-9fb6-88ee1c000420","Type":"ContainerDied","Data":"a2c4d3ab1e33c61c0a180e92bda2d7ea4fa724da7dcf48ff5006db0069f20d5d"}
Sep 10 13:08:19.184263 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:19.183887    2565 scope.go:117] "RemoveContainer" containerID="b7a9cc8743f0c6eee8d0a799ea96aee55625041eaac7a7086ab1e759f600e6fd"
Sep 10 13:08:19.211144 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:19.211117    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-r26xr"]
Sep 10 13:08:19.214884 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:19.214859    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-r26xr"]
Sep 10 13:08:19.394614 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:08:19.394585    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f65fcb-3b37-4fd6-9fb6-88ee1c000420" path="/var/lib/kubelet/pods/08f65fcb-3b37-4fd6-9fb6-88ee1c000420/volumes"
Sep 10 13:09:20.035537 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035502    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-ngrs5"]
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035802    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f65fcb-3b37-4fd6-9fb6-88ee1c000420" containerName="manager"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035813    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f65fcb-3b37-4fd6-9fb6-88ee1c000420" containerName="manager"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035821    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e455be9-fa25-495b-88e2-67461d14ccda" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035826    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e455be9-fa25-495b-88e2-67461d14ccda" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035832    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af559125-b33d-4b9c-b892-26013a9f1716" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035838    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af559125-b33d-4b9c-b892-26013a9f1716" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035845    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035850    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035856    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035861    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035869    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc44edf-4a7c-47be-a640-8514d7d295b9" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035874    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc44edf-4a7c-47be-a640-8514d7d295b9" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035880    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29ab123-0db8-44aa-9116-3f9fa0ada169" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035885    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29ab123-0db8-44aa-9116-3f9fa0ada169" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035940    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29ab123-0db8-44aa-9116-3f9fa0ada169" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035951    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc44edf-4a7c-47be-a640-8514d7d295b9" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035958    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af559125-b33d-4b9c-b892-26013a9f1716" containerName="maas-api"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035963    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f65fcb-3b37-4fd6-9fb6-88ee1c000420" containerName="manager"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035968    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035976    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035981    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy"
Sep 10 13:09:20.035991 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.035987    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e455be9-fa25-495b-88e2-67461d14ccda" containerName="maas-api"
Sep 10 13:09:20.038692 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.038676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.041481 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.041459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 13:09:20.042830 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.042802    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9t77v\""
Sep 10 13:09:20.042927 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.042906    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 13:09:20.042973 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.042910    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 13:09:20.051316 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.051289    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-ngrs5"]
Sep 10 13:09:20.149984 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.149945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-metrics-certs\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.149984 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.150000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vw95\" (UniqueName: \"kubernetes.io/projected/4a24d942-5d16-4d85-a1dd-70c300d10d59-kube-api-access-4vw95\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.150258 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.150029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-webhook-cert\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.250625 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.250586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-metrics-certs\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.250815 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.250635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vw95\" (UniqueName: \"kubernetes.io/projected/4a24d942-5d16-4d85-a1dd-70c300d10d59-kube-api-access-4vw95\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.250815 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.250664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-webhook-cert\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.253283 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.253250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-webhook-cert\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.253398 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.253250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-metrics-certs\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.260777 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.260750    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vw95\" (UniqueName: \"kubernetes.io/projected/4a24d942-5d16-4d85-a1dd-70c300d10d59-kube-api-access-4vw95\") pod \"maas-controller-6cf5bb6c98-ngrs5\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") " pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.348313 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.348203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:20.626449 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.626427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-ngrs5"]
Sep 10 13:09:20.627703 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:09:20.627664    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a24d942_5d16_4d85_a1dd_70c300d10d59.slice/crio-cffd98a369d08a80ed4562ba5076f94350958f5111eb777b2718c51b673a9a53 WatchSource:0}: Error finding container cffd98a369d08a80ed4562ba5076f94350958f5111eb777b2718c51b673a9a53: Status 404 returned error can't find the container with id cffd98a369d08a80ed4562ba5076f94350958f5111eb777b2718c51b673a9a53
Sep 10 13:09:20.629085 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:20.629069    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 13:09:21.471821 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:21.471777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5" event={"ID":"4a24d942-5d16-4d85-a1dd-70c300d10d59","Type":"ContainerStarted","Data":"0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28"}
Sep 10 13:09:21.472316 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:21.471844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5" event={"ID":"4a24d942-5d16-4d85-a1dd-70c300d10d59","Type":"ContainerStarted","Data":"cffd98a369d08a80ed4562ba5076f94350958f5111eb777b2718c51b673a9a53"}
Sep 10 13:09:21.472316 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:21.471891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:21.510122 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:21.510063    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5" podStartSLOduration=0.837049571 podStartE2EDuration="1.510046377s" totalImagesPullingTime="672.996806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:09:21.508321601 +0000 UTC m=+2352.628676177" watchObservedRunningTime="2026-09-10 13:09:21.510046377 +0000 UTC m=+2352.630400953"
Sep 10 13:09:32.478277 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:32.478234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:43.981399 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:43.981361    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-ngrs5"]
Sep 10 13:09:43.981987 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:43.981634    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5" podUID="4a24d942-5d16-4d85-a1dd-70c300d10d59" containerName="manager" containerID="cri-o://0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28" gracePeriod=30
Sep 10 13:09:44.228793 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.228763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:44.326226 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.326130    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-webhook-cert\") pod \"4a24d942-5d16-4d85-a1dd-70c300d10d59\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") "
Sep 10 13:09:44.326226 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.326197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-metrics-certs\") pod \"4a24d942-5d16-4d85-a1dd-70c300d10d59\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") "
Sep 10 13:09:44.326409 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.326266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vw95\" (UniqueName: \"kubernetes.io/projected/4a24d942-5d16-4d85-a1dd-70c300d10d59-kube-api-access-4vw95\") pod \"4a24d942-5d16-4d85-a1dd-70c300d10d59\" (UID: \"4a24d942-5d16-4d85-a1dd-70c300d10d59\") "
Sep 10 13:09:44.328429 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.328400    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4a24d942-5d16-4d85-a1dd-70c300d10d59" (UID: "4a24d942-5d16-4d85-a1dd-70c300d10d59"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:09:44.328429 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.328407    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a24d942-5d16-4d85-a1dd-70c300d10d59-kube-api-access-4vw95" (OuterVolumeSpecName: "kube-api-access-4vw95") pod "4a24d942-5d16-4d85-a1dd-70c300d10d59" (UID: "4a24d942-5d16-4d85-a1dd-70c300d10d59"). InnerVolumeSpecName "kube-api-access-4vw95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:09:44.328573 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.328433    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4a24d942-5d16-4d85-a1dd-70c300d10d59" (UID: "4a24d942-5d16-4d85-a1dd-70c300d10d59"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:09:44.427238 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.427172    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-webhook-cert\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:09:44.427238 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.427205    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a24d942-5d16-4d85-a1dd-70c300d10d59-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:09:44.427456 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.427250    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vw95\" (UniqueName: \"kubernetes.io/projected/4a24d942-5d16-4d85-a1dd-70c300d10d59-kube-api-access-4vw95\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:09:44.583126 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.583042    2565 generic.go:356] "Generic (PLEG): container finished" podID="4a24d942-5d16-4d85-a1dd-70c300d10d59" containerID="0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28" exitCode=0
Sep 10 13:09:44.583126 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.583086    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5"
Sep 10 13:09:44.583332 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.583121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5" event={"ID":"4a24d942-5d16-4d85-a1dd-70c300d10d59","Type":"ContainerDied","Data":"0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28"}
Sep 10 13:09:44.583332 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.583180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-ngrs5" event={"ID":"4a24d942-5d16-4d85-a1dd-70c300d10d59","Type":"ContainerDied","Data":"cffd98a369d08a80ed4562ba5076f94350958f5111eb777b2718c51b673a9a53"}
Sep 10 13:09:44.583332 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.583248    2565 scope.go:117] "RemoveContainer" containerID="0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28"
Sep 10 13:09:44.592918 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.592900    2565 scope.go:117] "RemoveContainer" containerID="0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28"
Sep 10 13:09:44.593184 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:09:44.593167    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28\": container with ID starting with 0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28 not found: ID does not exist" containerID="0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28"
Sep 10 13:09:44.593245 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.593192    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28"} err="failed to get container status \"0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28\": rpc error: code = NotFound desc = could not find container \"0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28\": container with ID starting with 0ac5e7f54a4d87fee671e566c2866965ec7cee504197fcfad13c2f1e68208a28 not found: ID does not exist"
Sep 10 13:09:44.617760 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.617729    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-ngrs5"]
Sep 10 13:09:44.625144 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:44.625118    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-ngrs5"]
Sep 10 13:09:45.394720 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.394682    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a24d942-5d16-4d85-a1dd-70c300d10d59" path="/var/lib/kubelet/pods/4a24d942-5d16-4d85-a1dd-70c300d10d59/volumes"
Sep 10 13:09:45.443054 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-pz7l4"]
Sep 10 13:09:45.443335 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443323    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a24d942-5d16-4d85-a1dd-70c300d10d59" containerName="manager"
Sep 10 13:09:45.443379 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443336    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a24d942-5d16-4d85-a1dd-70c300d10d59" containerName="manager"
Sep 10 13:09:45.443379 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443346    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy"
Sep 10 13:09:45.443379 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443352    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy"
Sep 10 13:09:45.443379 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443359    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy"
Sep 10 13:09:45.443379 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443364    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9915f6-9ad2-45f8-995c-4ba8dd7cfe8a" containerName="istio-proxy"
Sep 10 13:09:45.443556 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443422    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a24d942-5d16-4d85-a1dd-70c300d10d59" containerName="manager"
Sep 10 13:09:45.443556 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.443432    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cda6db8-8074-428d-a189-4b600f34382b" containerName="istio-proxy"
Sep 10 13:09:45.447596 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.447578    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.452840 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.452815    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 13:09:45.452961 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.452855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9t77v\""
Sep 10 13:09:45.452961 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.452904    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 13:09:45.453264 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.453244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 13:09:45.466151 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.466129    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-pz7l4"]
Sep 10 13:09:45.534474 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.534442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/130a1b41-b41c-425f-960a-baa15c6adabe-webhook-cert\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.534651 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.534482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/130a1b41-b41c-425f-960a-baa15c6adabe-metrics-certs\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.534651 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.534503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6x8v\" (UniqueName: \"kubernetes.io/projected/130a1b41-b41c-425f-960a-baa15c6adabe-kube-api-access-l6x8v\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.634933 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.634900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/130a1b41-b41c-425f-960a-baa15c6adabe-webhook-cert\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.634933 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.634939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/130a1b41-b41c-425f-960a-baa15c6adabe-metrics-certs\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.635186 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.634956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6x8v\" (UniqueName: \"kubernetes.io/projected/130a1b41-b41c-425f-960a-baa15c6adabe-kube-api-access-l6x8v\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.637640 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.637614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/130a1b41-b41c-425f-960a-baa15c6adabe-webhook-cert\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.637732 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.637614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/130a1b41-b41c-425f-960a-baa15c6adabe-metrics-certs\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.645084 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.645032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6x8v\" (UniqueName: \"kubernetes.io/projected/130a1b41-b41c-425f-960a-baa15c6adabe-kube-api-access-l6x8v\") pod \"maas-controller-6cf5bb6c98-pz7l4\" (UID: \"130a1b41-b41c-425f-960a-baa15c6adabe\") " pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:45.757369 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:45.757338    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:46.032884 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:46.032859    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cf5bb6c98-pz7l4"]
Sep 10 13:09:46.034645 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:09:46.034622    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130a1b41_b41c_425f_960a_baa15c6adabe.slice/crio-788d700eac20c3c3537806dfb800a4b500df25ee1fcb3d7496d6160aba6cc532 WatchSource:0}: Error finding container 788d700eac20c3c3537806dfb800a4b500df25ee1fcb3d7496d6160aba6cc532: Status 404 returned error can't find the container with id 788d700eac20c3c3537806dfb800a4b500df25ee1fcb3d7496d6160aba6cc532
Sep 10 13:09:46.594767 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:46.594727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4" event={"ID":"130a1b41-b41c-425f-960a-baa15c6adabe","Type":"ContainerStarted","Data":"d39f8dec8ee5570e0ebed85c380c7ae7e34180ffe8a1765f1eec50fe8e7523b8"}
Sep 10 13:09:46.595168 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:46.594921    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:46.595168 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:46.594953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4" event={"ID":"130a1b41-b41c-425f-960a-baa15c6adabe","Type":"ContainerStarted","Data":"788d700eac20c3c3537806dfb800a4b500df25ee1fcb3d7496d6160aba6cc532"}
Sep 10 13:09:57.602417 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:57.602385    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4"
Sep 10 13:09:57.632339 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:09:57.632257    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cf5bb6c98-pz7l4" podStartSLOduration=12.202355101 podStartE2EDuration="12.632240586s" totalImagesPullingTime="429.885485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:09:46.638050499 +0000 UTC m=+2377.758405073" watchObservedRunningTime="2026-09-10 13:09:57.632240586 +0000 UTC m=+2388.752595163"
Sep 10 13:14:10.018077 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.018036    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"]
Sep 10 13:14:10.021304 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.021285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.040596 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.040572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"]
Sep 10 13:14:10.166313 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.166278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d7b5da-059b-4861-842f-94eea52b4b69-maas-api-tls\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.166313 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.166310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pxgc\" (UniqueName: \"kubernetes.io/projected/a1d7b5da-059b-4861-842f-94eea52b4b69-kube-api-access-9pxgc\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.166523 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.166340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d7b5da-059b-4861-842f-94eea52b4b69-openshift-service-ca\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.166523 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.166477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1d7b5da-059b-4861-842f-94eea52b4b69-metrics-certs\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.267789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.267750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d7b5da-059b-4861-842f-94eea52b4b69-maas-api-tls\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.267789 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.267789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pxgc\" (UniqueName: \"kubernetes.io/projected/a1d7b5da-059b-4861-842f-94eea52b4b69-kube-api-access-9pxgc\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.267995 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.267817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d7b5da-059b-4861-842f-94eea52b4b69-openshift-service-ca\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.267995 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.267898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1d7b5da-059b-4861-842f-94eea52b4b69-metrics-certs\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.268736 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.268545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d7b5da-059b-4861-842f-94eea52b4b69-openshift-service-ca\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.270487 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.270465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d7b5da-059b-4861-842f-94eea52b4b69-maas-api-tls\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.270580 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.270506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1d7b5da-059b-4861-842f-94eea52b4b69-metrics-certs\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.280734 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.280709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pxgc\" (UniqueName: \"kubernetes.io/projected/a1d7b5da-059b-4861-842f-94eea52b4b69-kube-api-access-9pxgc\") pod \"maas-api-b4867cdb8-xhk2c\" (UID: \"a1d7b5da-059b-4861-842f-94eea52b4b69\") " pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.330777 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.330753    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:10.651172 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.651097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"]
Sep 10 13:14:10.654273 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:14:10.654248    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d7b5da_059b_4861_842f_94eea52b4b69.slice/crio-5ace39ea3d16182be6b32fbd26ed281e3dad52c6bf19b2e68dab59282b5be86f WatchSource:0}: Error finding container 5ace39ea3d16182be6b32fbd26ed281e3dad52c6bf19b2e68dab59282b5be86f: Status 404 returned error can't find the container with id 5ace39ea3d16182be6b32fbd26ed281e3dad52c6bf19b2e68dab59282b5be86f
Sep 10 13:14:10.848376 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:10.848341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c" event={"ID":"a1d7b5da-059b-4861-842f-94eea52b4b69","Type":"ContainerStarted","Data":"5ace39ea3d16182be6b32fbd26ed281e3dad52c6bf19b2e68dab59282b5be86f"}
Sep 10 13:14:11.855274 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:11.855237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c" event={"ID":"a1d7b5da-059b-4861-842f-94eea52b4b69","Type":"ContainerStarted","Data":"17a252eee1c4c49277bb9d9823bfc930a3dcac48223d37c033191787c0180e52"}
Sep 10 13:14:11.855672 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:11.855368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:11.886989 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:11.886928    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c" podStartSLOduration=2.308457532 podStartE2EDuration="2.886908342s" totalImagesPullingTime="578.45081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 13:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:14:11.882428379 +0000 UTC m=+2643.002782955" watchObservedRunningTime="2026-09-10 13:14:11.886908342 +0000 UTC m=+2643.007262923"
Sep 10 13:14:17.866554 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:17.866524    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b4867cdb8-xhk2c"
Sep 10 13:14:26.896844 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:26.896804    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"]
Sep 10 13:14:26.897366 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:26.897002    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg" podUID="cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" containerName="maas-api" containerID="cri-o://fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540" gracePeriod=30
Sep 10 13:14:28.140499 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.140471    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 13:14:28.332366 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.332281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-maas-api-tls\") pod \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") "
Sep 10 13:14:28.332536 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.332373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7wk5\" (UniqueName: \"kubernetes.io/projected/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-kube-api-access-z7wk5\") pod \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") "
Sep 10 13:14:28.332536 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.332405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-metrics-certs\") pod \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") "
Sep 10 13:14:28.332536 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.332432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-openshift-service-ca\") pod \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\" (UID: \"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7\") "
Sep 10 13:14:28.332888 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.332852    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" (UID: "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 13:14:28.334761 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.334732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" (UID: "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:14:28.334857 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.334771    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" (UID: "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 13:14:28.334857 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.334773    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-kube-api-access-z7wk5" (OuterVolumeSpecName: "kube-api-access-z7wk5") pod "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" (UID: "cd2c14df-1b3d-4d26-b831-c8e00a6eeae7"). InnerVolumeSpecName "kube-api-access-z7wk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 13:14:28.434055 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.434022    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-maas-api-tls\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:14:28.434055 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.434050    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7wk5\" (UniqueName: \"kubernetes.io/projected/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-kube-api-access-z7wk5\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:14:28.434055 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.434059    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-metrics-certs\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:14:28.434321 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.434067    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7-openshift-service-ca\") on node \"ip-10-0-130-88.ec2.internal\" DevicePath \"\""
Sep 10 13:14:28.938115 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.938081    2565 generic.go:356] "Generic (PLEG): container finished" podID="cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" containerID="fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540" exitCode=0
Sep 10 13:14:28.938334 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.938126    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"
Sep 10 13:14:28.938334 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.938168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg" event={"ID":"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7","Type":"ContainerDied","Data":"fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540"}
Sep 10 13:14:28.938334 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.938240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg" event={"ID":"cd2c14df-1b3d-4d26-b831-c8e00a6eeae7","Type":"ContainerDied","Data":"42cadddd2b32b4f545907b4ebcc7e21bdb6ec46912904602d780fb09953e1f7e"}
Sep 10 13:14:28.938334 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.938271    2565 scope.go:117] "RemoveContainer" containerID="fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540"
Sep 10 13:14:28.947522 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.947507    2565 scope.go:117] "RemoveContainer" containerID="fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540"
Sep 10 13:14:28.947799 ip-10-0-130-88 kubenswrapper[2565]: E0910 13:14:28.947779    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540\": container with ID starting with fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540 not found: ID does not exist" containerID="fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540"
Sep 10 13:14:28.947864 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.947806    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540"} err="failed to get container status \"fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540\": rpc error: code = NotFound desc = could not find container \"fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540\": container with ID starting with fe6f34ec4b7298bfe305f6b5d0d59af6cff7b81ece5e5e8c1ef3ca07c87bc540 not found: ID does not exist"
Sep 10 13:14:28.976796 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.976770    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"]
Sep 10 13:14:28.983439 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:28.983417    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg"]
Sep 10 13:14:29.394337 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:29.394257    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" path="/var/lib/kubelet/pods/cd2c14df-1b3d-4d26-b831-c8e00a6eeae7/volumes"
Sep 10 13:14:31.067620 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:31.067577    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-7797f985f6-5nhpg" podUID="cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.33:8443/health\": context deadline exceeded"
Sep 10 13:14:47.839101 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:47.839066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cf5bb6c98-pz7l4_130a1b41-b41c-425f-960a-baa15c6adabe/manager/0.log"
Sep 10 13:14:48.101815 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:48.101739    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xt8nr_f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e/manager/0.log"
Sep 10 13:14:48.555415 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:48.555388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-669b9dff44-nlkdz_433fabc9-5273-4432-9544-a41f855c14d2/copy-manifests/0.log"
Sep 10 13:14:48.568842 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:48.568819    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-669b9dff44-nlkdz_433fabc9-5273-4432-9544-a41f855c14d2/manager/0.log"
Sep 10 13:14:49.082274 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:49.082193    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b4867cdb8-xhk2c_a1d7b5da-059b-4861-842f-94eea52b4b69/maas-api/0.log"
Sep 10 13:14:51.483585 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:51.483557    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2_086331ff-7e95-464a-b3ca-1b3b33ca551f/istio-proxy/0.log"
Sep 10 13:14:51.608181 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:51.608152    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m5lbb_9b16f181-f723-454b-90f6-cc34e382dd45/discovery/0.log"
Sep 10 13:14:52.728091 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:52.728057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-g5vzj_839dd743-61d1-4251-8e45-fad7039f002b/main/0.log"
Sep 10 13:14:53.097112 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:14:53.097034    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-g5jvj_2cfc1ad4-4bab-4880-83d3-7d3b0fb6c03d/main/0.log"
Sep 10 13:15:03.199888 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:03.199809    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rnjkw_b70159bb-bbec-4946-b9aa-9e5a61d3a847/global-pull-secret-syncer/0.log"
Sep 10 13:15:03.388376 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:03.388340    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sksv5_669814f0-ac4f-4c5a-8070-820e7ff46462/konnectivity-agent/0.log"
Sep 10 13:15:03.418759 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:03.418734    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-88.ec2.internal_1ec8bd4921b9fbbb4ef0d7416c6238f1/haproxy/0.log"
Sep 10 13:15:11.104136 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:11.104100    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hvs26_d48901e4-37c7-4770-92be-f89c806dc979/node-exporter/0.log"
Sep 10 13:15:11.151566 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:11.151533    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hvs26_d48901e4-37c7-4770-92be-f89c806dc979/kube-rbac-proxy/0.log"
Sep 10 13:15:11.226945 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:11.226916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hvs26_d48901e4-37c7-4770-92be-f89c806dc979/init-textfile/0.log"
Sep 10 13:15:13.453078 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.453036    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"]
Sep 10 13:15:13.453562 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.453499    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" containerName="maas-api"
Sep 10 13:15:13.453562 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.453519    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" containerName="maas-api"
Sep 10 13:15:13.453674 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.453598    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd2c14df-1b3d-4d26-b831-c8e00a6eeae7" containerName="maas-api"
Sep 10 13:15:13.457705 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.457684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.461433 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.461414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fkh8h\"/\"default-dockercfg-dskqh\""
Sep 10 13:15:13.462264 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.462245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fkh8h\"/\"openshift-service-ca.crt\""
Sep 10 13:15:13.462370 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.462251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fkh8h\"/\"kube-root-ca.crt\""
Sep 10 13:15:13.468904 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.468881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"]
Sep 10 13:15:13.603698 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.603645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-podres\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.603893 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.603770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-proc\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.603893 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.603817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-sys\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.603893 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.603864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-lib-modules\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.603893 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.603881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqwx\" (UniqueName: \"kubernetes.io/projected/4a6778c3-8465-4d78-a061-61ce2726463e-kube-api-access-gfqwx\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705329 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-podres\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705329 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-proc\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705329 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-sys\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705575 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-lib-modules\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705575 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqwx\" (UniqueName: \"kubernetes.io/projected/4a6778c3-8465-4d78-a061-61ce2726463e-kube-api-access-gfqwx\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705575 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-podres\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705575 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-proc\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705575 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-sys\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.705575 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.705489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a6778c3-8465-4d78-a061-61ce2726463e-lib-modules\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.716130 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.716104    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqwx\" (UniqueName: \"kubernetes.io/projected/4a6778c3-8465-4d78-a061-61ce2726463e-kube-api-access-gfqwx\") pod \"perf-node-gather-daemonset-t6mpl\" (UID: \"4a6778c3-8465-4d78-a061-61ce2726463e\") " pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:13.768747 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:13.768711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:14.059089 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:14.059012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"]
Sep 10 13:15:14.064265 ip-10-0-130-88 kubenswrapper[2565]: W0910 13:15:14.064233    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4a6778c3_8465_4d78_a061_61ce2726463e.slice/crio-9a78888403648c6e9937c1d7b30c575a06a715eae8dd6785e479960680e937ef WatchSource:0}: Error finding container 9a78888403648c6e9937c1d7b30c575a06a715eae8dd6785e479960680e937ef: Status 404 returned error can't find the container with id 9a78888403648c6e9937c1d7b30c575a06a715eae8dd6785e479960680e937ef
Sep 10 13:15:14.154226 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:14.154185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl" event={"ID":"4a6778c3-8465-4d78-a061-61ce2726463e","Type":"ContainerStarted","Data":"9a78888403648c6e9937c1d7b30c575a06a715eae8dd6785e479960680e937ef"}
Sep 10 13:15:15.160268 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:15.160231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl" event={"ID":"4a6778c3-8465-4d78-a061-61ce2726463e","Type":"ContainerStarted","Data":"d0f1253899e48b5a68a431b5a16ec117d8203912c81aa642373774b83e83d32c"}
Sep 10 13:15:15.160658 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:15.160297    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:15.200199 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:15.200151    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl" podStartSLOduration=2.200137476 podStartE2EDuration="2.200137476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:15:15.198930906 +0000 UTC m=+2706.319285484" watchObservedRunningTime="2026-09-10 13:15:15.200137476 +0000 UTC m=+2706.320492065"
Sep 10 13:15:17.354708 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:17.354653    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dcsnd_3cbfec41-74aa-4b2d-9f78-7403b3630669/dns/0.log"
Sep 10 13:15:17.396441 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:17.396407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dcsnd_3cbfec41-74aa-4b2d-9f78-7403b3630669/kube-rbac-proxy/0.log"
Sep 10 13:15:17.539995 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:17.539958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-54nhs_33d8dbaa-f07e-413b-b890-2e2d1558c504/dns-node-resolver/0.log"
Sep 10 13:15:18.337877 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:18.337848    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nwfn_ea64abff-11bc-4017-a4bc-a743c0bfaa58/node-ca/0.log"
Sep 10 13:15:19.533130 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:19.533101    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2_086331ff-7e95-464a-b3ca-1b3b33ca551f/istio-proxy/0.log"
Sep 10 13:15:19.849533 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:19.849430    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m5lbb_9b16f181-f723-454b-90f6-cc34e382dd45/discovery/0.log"
Sep 10 13:15:21.175996 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:21.175968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fkh8h/perf-node-gather-daemonset-t6mpl"
Sep 10 13:15:21.747086 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:21.747059    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r2q87_456583ce-77c9-4ee0-b771-bb8cc82efb51/serve-healthcheck-canary/0.log"
Sep 10 13:15:22.884838 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:22.884799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-pl9sc_8f601840-4af3-412b-b97b-8111a7b8a4a6/insights-operator/0.log"
Sep 10 13:15:22.885317 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:22.885146    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-pl9sc_8f601840-4af3-412b-b97b-8111a7b8a4a6/insights-operator/1.log"
Sep 10 13:15:23.174889 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:23.174858    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dx6tl_67734282-79f6-4cd4-a7fe-2b99faea294f/kube-rbac-proxy/0.log"
Sep 10 13:15:23.242349 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:23.242318    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dx6tl_67734282-79f6-4cd4-a7fe-2b99faea294f/exporter/0.log"
Sep 10 13:15:23.322162 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:23.322130    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dx6tl_67734282-79f6-4cd4-a7fe-2b99faea294f/extractor/0.log"
Sep 10 13:15:23.431168 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:23.431093    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2_086331ff-7e95-464a-b3ca-1b3b33ca551f/istio-proxy/0.log"
Sep 10 13:15:23.721381 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:23.721350    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m5lbb_9b16f181-f723-454b-90f6-cc34e382dd45/discovery/0.log"
Sep 10 13:15:25.750542 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:25.750470    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fphh2_086331ff-7e95-464a-b3ca-1b3b33ca551f/istio-proxy/0.log"
Sep 10 13:15:26.063068 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:26.062984    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m5lbb_9b16f181-f723-454b-90f6-cc34e382dd45/discovery/0.log"
Sep 10 13:15:27.059206 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:27.059169    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cf5bb6c98-pz7l4_130a1b41-b41c-425f-960a-baa15c6adabe/manager/0.log"
Sep 10 13:15:27.202787 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:27.202757    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xt8nr_f0a0b341-cb57-4b8e-8bba-5ee5c3644f5e/manager/0.log"
Sep 10 13:15:27.503523 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:27.503496    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-669b9dff44-nlkdz_433fabc9-5273-4432-9544-a41f855c14d2/manager/0.log"
Sep 10 13:15:27.544104 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:27.544079    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-669b9dff44-nlkdz_433fabc9-5273-4432-9544-a41f855c14d2/copy-manifests/0.log"
Sep 10 13:15:28.847398 ip-10-0-130-88 kubenswrapper[2565]: I0910 13:15:28.847362    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d95565f4b-v5vbg_b76a1709-912b-45f2-a6b2-9c6b2f356f6d/manager/0.log"