Sep 10 19:18:10.079177 ip-10-0-132-149 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 19:18:10.079262 ip-10-0-132-149 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 19:18:10.079274 ip-10-0-132-149 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 19:18:10.079486 ip-10-0-132-149 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 19:18:21.159311 ip-10-0-132-149 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 19:18:21.159326 ip-10-0-132-149 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot eae501e994b74a89849d5ecd70e3c00c --
Sep 10 19:20:11.074691 ip-10-0-132-149 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 19:20:11.467412 ip-10-0-132-149 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:20:11.467412 ip-10-0-132-149 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 19:20:11.467412 ip-10-0-132-149 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:20:11.467412 ip-10-0-132-149 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 19:20:11.467412 ip-10-0-132-149 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 19:20:11.468070 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.467410    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 19:20:11.471712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471695    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:20:11.471712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471712    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471715    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471719    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471723    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471726    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471730    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471732    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471735    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471738    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471741    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471743    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471746    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471754    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471758    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471762    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471766    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471769    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471772    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471775    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:20:11.471779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471778    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471781    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471784    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471788    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471792    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471796    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471799    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471802    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471804    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471807    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471810    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471812    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471814    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471817    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471819    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471823    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471826    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471828    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471835    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:20:11.472237 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471838    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471840    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471843    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471845    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471848    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471851    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471853    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471856    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471858    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471861    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471864    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471866    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471869    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471871    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471874    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471878    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471882    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471885    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471888    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471891    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:20:11.472721 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471893    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471896    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471899    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471901    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471904    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471907    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471910    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471914    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471917    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471919    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471922    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471924    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471927    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471930    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471933    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471936    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471938    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471941    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471944    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471946    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:20:11.473203 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471949    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471951    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471954    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471957    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471959    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471962    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471965    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471968    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471971    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471974    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471977    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471979    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471982    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471984    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471987    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471990    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471992    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471995    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.471997    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472000    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:20:11.473712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472690    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472697    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472700    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472703    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472706    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472709    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472711    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472714    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472717    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472720    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472722    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472726    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472728    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472731    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472734    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472737    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472739    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472743    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472746    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472748    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:20:11.474210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472751    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472754    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472756    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472759    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472762    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472764    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472767    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472769    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472772    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472775    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472777    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472780    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472782    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472785    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472788    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472790    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472793    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472796    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472799    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472802    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:20:11.474788 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472804    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472807    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472809    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472812    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472815    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472817    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472820    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472823    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472825    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472828    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472831    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472834    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472836    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472840    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472843    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472845    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472847    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472850    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472852    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472855    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:20:11.475274 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472857    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472864    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472866    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472869    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472871    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472874    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472877    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472879    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472882    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472884    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472887    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472890    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472893    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472895    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472898    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472901    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472905    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472909    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472912    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:20:11.475778 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472915    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472918    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472921    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472925    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472929    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472932    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472935    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472938    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472941    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472944    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472947    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472950    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472952    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472955    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472959    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472962    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472965    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472968    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472970    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:20:11.476246 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.472973    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473350    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473358    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473361    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473365    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473368    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473386    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473389    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473392    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473395    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473397    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473400    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473403    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473405    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473408    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473411    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473414    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473417    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473420    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473423    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:20:11.476730 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473426    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473429    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473431    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473435    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473439    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473442    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473445    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473448    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473451    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473453    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473456    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473459    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473461    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473464    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473468    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473470    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473473    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473475    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473479    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:20:11.477217 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473482    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473484    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473488    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473491    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473494    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473497    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473500    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473502    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473506    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473508    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473511    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473514    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473516    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473519    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473522    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473524    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473527    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473529    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473532    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:20:11.477703 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473534    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473537    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473540    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473543    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473546    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473548    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473553    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473555    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473559    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473562    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473565    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473567    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473570    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473573    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473576    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473580    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473582    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473585    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473587    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473590    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:20:11.478195 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473593    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473595    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473598    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473601    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473604    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473607    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473610    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473612    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473615    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473618    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473620    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473623    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473625    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473628    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473630    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473633    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473635    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473638    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473642    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473644    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:20:11.478701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473648    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.473650    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473719    2558 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473756    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473762    2558 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473769    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473774    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473777    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473781    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473785    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473788    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473792    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473795    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473799    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473802    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473805    2558 flags.go:64] FLAG: --cgroup-root=""
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473808    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473811    2558 flags.go:64] FLAG: --client-ca-file=""
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473814    2558 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473817    2558 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473821    2558 flags.go:64] FLAG: --cluster-domain=""
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473824    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473827    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473830    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 19:20:11.479216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473833    2558 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473837    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473840    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473843    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473847    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473850    2558 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473854    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473857    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473862    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473865    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473869    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473871    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473875    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473878    2558 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473881    2558 flags.go:64] FLAG: --enable-server="true"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473885    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473889    2558 flags.go:64] FLAG: --event-burst="100"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473892    2558 flags.go:64] FLAG: --event-qps="50"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473895    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473898    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473901    2558 flags.go:64] FLAG: --eviction-hard=""
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473905    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473907    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473910    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473913    2558 flags.go:64] FLAG: --eviction-soft=""
Sep 10 19:20:11.479790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473916    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473919    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473922    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473924    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473927    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473930    2558 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473933    2558 flags.go:64] FLAG: --feature-gates=""
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473936    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473939    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473942    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473945    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473948    2558 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473951    2558 flags.go:64] FLAG: --help="false"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473955    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473958    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473963    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473966    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473969    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473972    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473975    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473978    2558 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473981    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473984    2558 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 19:20:11.480415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473987    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473991    2558 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473993    2558 flags.go:64] FLAG: --kube-reserved=""
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473996    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.473999    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474002    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474005    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474008    2558 flags.go:64] FLAG: --lock-file=""
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474010    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474013    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474016    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474021    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474024    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474027    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474029    2558 flags.go:64] FLAG: --logging-format="text"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474032    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474036    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474039    2558 flags.go:64] FLAG: --manifest-url=""
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474041    2558 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474045    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474048    2558 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474052    2558 flags.go:64] FLAG: --max-pods="110"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474059    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474062    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474066    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 19:20:11.481096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474068    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474071    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474074    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474077    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474085    2558 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474088    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474091    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474094    2558 flags.go:64] FLAG: --pod-cidr=""
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474098    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474104    2558 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474106    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474109    2558 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474112    2558 flags.go:64] FLAG: --port="10250"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474115    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474118    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06a41994cf3d37f41"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474121    2558 flags.go:64] FLAG: --qos-reserved=""
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474124    2558 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474127    2558 flags.go:64] FLAG: --register-node="true"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474130    2558 flags.go:64] FLAG: --register-with-taints=""
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474134    2558 flags.go:64] FLAG: --registry-burst="10"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474136    2558 flags.go:64] FLAG: --registry-qps="5"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474139    2558 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474142    2558 flags.go:64] FLAG: --reserved-memory=""
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474146    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474149    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 19:20:11.481717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474152    2558 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474155    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474157    2558 flags.go:64] FLAG: --runonce="false"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474160    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474165    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474168    2558 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474170    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474175    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474177    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474181    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474184    2558 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474186    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474189    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474192    2558 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474195    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474198    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474202    2558 flags.go:64] FLAG: --system-cgroups=""
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474205    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474210    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474213    2558 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474216    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474220    2558 flags.go:64] FLAG: --tls-min-version=""
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474223    2558 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474226    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474229    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 19:20:11.482325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474232    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474235    2558 flags.go:64] FLAG: --v="2"
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474238    2558 flags.go:64] FLAG: --version="false"
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474243    2558 flags.go:64] FLAG: --vmodule=""
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474246    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.474249    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474361    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474365    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474368    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474382    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474386    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474390    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474393    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474397    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474402    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474413    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474416    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474420    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474424    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474427    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474430    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:20:11.482975 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474432    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474435    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474438    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474441    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474445    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474447    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474450    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474453    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474456    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474460    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474463    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474466    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474469    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474472    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474474    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474477    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474480    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474519    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474525    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:20:11.483518 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474529    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474533    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474537    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474540    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474543    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474546    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474549    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474552    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474555    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474557    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474560    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474563    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474566    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474568    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474571    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474573    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474576    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474579    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474582    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474584    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:20:11.484052 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474587    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474590    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474592    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474595    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474598    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474600    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474605    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474610    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474614    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474617    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474620    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474624    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474627    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474630    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474633    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474636    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474638    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474641    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474643    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474646    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:20:11.484859 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474648    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474651    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474653    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474656    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474659    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474662    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474664    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474667    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474670    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474672    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474675    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474677    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474680    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474682    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474685    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474687    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474689    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474696    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474698    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474701    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:20:11.485355 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474704    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474708    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474710    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474713    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.474716    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.475565    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.482200    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.482213    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.482228    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.482235    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482288    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482294    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482297    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482301    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:20:11.485885 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482304    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482308    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482312    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482315    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482318    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482321    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482324    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482327    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482330    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482334    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482337    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482341    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482344    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482347    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482349    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482352    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482354    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482357    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482360    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:20:11.486243 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482362    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482365    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482368    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482385    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482388    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482391    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482396    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482400    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482410    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482414    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482416    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482419    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482422    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482425    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482428    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482431    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482433    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482436    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482439    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482441    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:20:11.486768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482443    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482446    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482448    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482451    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482454    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482457    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482460    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482463    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482467    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482470    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482473    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482476    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482479    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482482    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482484    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482487    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482489    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482492    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482495    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:20:11.487262 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482498    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482500    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482503    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482506    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482508    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482511    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482514    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482517    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482519    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482522    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482524    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482527    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482529    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482532    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482534    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482537    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482539    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482542    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482544    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482547    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:20:11.487733 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482550    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482552    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482555    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482557    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482560    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482562    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482565    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482568    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482570    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482573    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482575    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482579    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482582    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482584    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482587    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482589    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:20:11.488216 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482592    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.482597    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482707    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482712    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482715    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482719    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482722    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482725    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482727    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482730    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482732    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482735    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482737    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482740    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 19:20:11.488627 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482742    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482746    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482750    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482753    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482757    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482760    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482762    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482765    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482767    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482770    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482773    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482775    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482778    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482782    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482786    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482789    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482791    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482794    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482797    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 19:20:11.488972 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482800    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482802    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482805    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482808    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482811    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482813    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482816    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482819    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482821    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482824    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482826    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482829    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482831    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482834    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482836    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482839    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482842    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482844    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482847    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482850    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 19:20:11.489464 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482852    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482855    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482857    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482859    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482863    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482866    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482869    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482871    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482874    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482876    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482879    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482881    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482884    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482886    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482889    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482891    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482894    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482896    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482899    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482901    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 19:20:11.489928 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482903    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482906    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482908    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482911    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482913    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482916    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482918    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482921    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482923    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482926    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482929    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482932    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482934    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482936    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482939    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482941    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482944    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482947    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482949    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482952    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 19:20:11.490433 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482954    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482957    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482960    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482962    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482964    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482967    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482970    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:11.482972    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.482977    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.483076    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.486240    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.487207    2558 server.go:1019] "Starting client certificate rotation"
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.487299    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 19:20:11.490913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.487328    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 19:20:11.491243 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.489874    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 19:20:11.491243 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.491018    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 19:20:11.501451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.501420    2558 log.go:25] "Validated CRI v1 runtime API"
Sep 10 19:20:11.505312 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.505299    2558 log.go:25] "Validated CRI v1 image API"
Sep 10 19:20:11.506167 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.506155    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 19:20:11.508570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.508547    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83821cf1-8782-4cde-8636-9c26f1d31247:/dev/nvme0n1p4 9d9436ff-94fb-475a-9428-800bd73c87c2:/dev/nvme0n1p3]
Sep 10 19:20:11.508626 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.508569    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 19:20:11.513940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.513818    2558 manager.go:216] Machine: {Timestamp:2026-09-10 19:20:11.512281304 +0000 UTC m=+0.328890882 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3072827 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21eff21f7c457465ffb438a951258e SystemUUID:ec21eff2-1f7c-4574-65ff-b438a951258e BootID:eae501e9-94b7-4a89-849d-5ecd70e3c00c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:33:ce:06:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:33:ce:06:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:42:87:f8:a8:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 19:20:11.513940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.513939    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 19:20:11.514057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.514047    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 19:20:11.517029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.516994    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 19:20:11.517167 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.517152    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 19:20:11.517208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.517029    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-149.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 19:20:11.517796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.517785    2558 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 19:20:11.517826 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.517799    2558 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 19:20:11.517826 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.517807    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 19:20:11.517826 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.517820    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 19:20:11.518614 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.518601    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 19:20:11.521693 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.521681    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 19:20:11.521821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.521811    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 19:20:11.521857 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.521847    2558 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 19:20:11.521885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.521862    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 19:20:11.521885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.521876    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 19:20:11.521885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.521885    2558 kubelet.go:398] "Adding apiserver pod source"
Sep 10 19:20:11.521991 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.521893    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 19:20:11.522332 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.522318    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 19:20:11.522412 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.522342    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 19:20:11.525693 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.525673    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 19:20:11.527645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.527633    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 19:20:11.527752 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.527664    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 19:20:11.528771 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528759    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 19:20:11.528805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528776    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 19:20:11.528805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528782    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 19:20:11.528805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528787    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 19:20:11.528805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528796    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 19:20:11.528805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528802    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 19:20:11.528935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528815    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 19:20:11.528935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528820    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 19:20:11.528935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528827    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 19:20:11.528935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528832    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 19:20:11.528935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528841    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 19:20:11.528935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.528846    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 19:20:11.529801 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.529789    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 19:20:11.529801 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.529799    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 19:20:11.532611 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.532589    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-149.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 19:20:11.533036 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.533017    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 19:20:11.533085 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.533019    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 19:20:11.533597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.533586    2558 server.go:1268] "Started kubelet"
Sep 10 19:20:11.533702 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.533672    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 19:20:11.533765 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.533669    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 19:20:11.533765 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.533739    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 19:20:11.534325 ip-10-0-132-149 systemd[1]: Started Kubernetes Kubelet.
Sep 10 19:20:11.534699 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.534683    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 19:20:11.537054 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.536804    2558 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 19:20:11.538089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.538020    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lmdqx"
Sep 10 19:20:11.538709 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.538680    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 19:20:11.541972 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.541955    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 19:20:11.542621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.542603    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 19:20:11.542804 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.542788    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:11.543214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543195    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 19:20:11.543308 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543201    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 19:20:11.543308 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543213    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 19:20:11.543433 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543335    2558 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 19:20:11.543433 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543351    2558 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 19:20:11.543509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543441    2558 factory.go:55] Registering systemd factory
Sep 10 19:20:11.543509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543458    2558 factory.go:223] Registration of the systemd container factory successfully
Sep 10 19:20:11.543664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543650    2558 factory.go:153] Registering CRI-O factory
Sep 10 19:20:11.543712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543667    2558 factory.go:223] Registration of the crio container factory successfully
Sep 10 19:20:11.543742 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543717    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 19:20:11.543742 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543735    2558 factory.go:103] Registering Raw factory
Sep 10 19:20:11.543801 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.543749    2558 manager.go:1196] Started watching for new ooms in manager
Sep 10 19:20:11.544085 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.544070    2558 manager.go:349] Starting recovery of all containers
Sep 10 19:20:11.546428 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.546400    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lmdqx"
Sep 10 19:20:11.549946 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.549912    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 19:20:11.550036 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.550011    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 19:20:11.550104 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.549129    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-149.ec2.internal.18d40be0aa78e857  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-149.ec2.internal,UID:ip-10-0-132-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-149.ec2.internal,},FirstTimestamp:2026-09-10 19:20:11.533559895 +0000 UTC m=+0.350169454,LastTimestamp:2026-09-10 19:20:11.533559895 +0000 UTC m=+0.350169454,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-149.ec2.internal,}"
Sep 10 19:20:11.556195 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.556124    2558 manager.go:354] Recovery completed
Sep 10 19:20:11.561510 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.561494    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:20:11.563358 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.563339    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:20:11.563441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.563388    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:20:11.563441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.563402    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:20:11.563966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.563953    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 19:20:11.563966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.563965    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 19:20:11.564047 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.563979    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 19:20:11.564047 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.564022    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:20:11.564719 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.564704    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:20:11.564775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.564733    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:20:11.564775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.564747    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:20:11.564860 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.564848    2558 policy_none.go:49] "None policy: Start"
Sep 10 19:20:11.564895 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.564864    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 19:20:11.564895 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.564874    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 19:20:11.565771 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.565761    2558 policy_none.go:47] "Start"
Sep 10 19:20:11.643573 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.643548    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:11.647519 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.647495    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 19:20:11.648694 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.648679    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 19:20:11.648784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.648730    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 19:20:11.648784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.648760    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 19:20:11.648870 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.648805    2558 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 10 19:20:11.651187 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.651169    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:20:11.729924 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.729908    2558 manager.go:337] "Starting Device Plugin manager"
Sep 10 19:20:11.730015 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.729949    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 19:20:11.730015 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.729959    2558 server.go:87] "Starting device plugin registration server"
Sep 10 19:20:11.730230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.730213    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 19:20:11.730334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.730231    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 19:20:11.730334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.730314    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 19:20:11.730467 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.730400    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 19:20:11.730467 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.730417    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 19:20:11.730993 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.730972    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 19:20:11.731067 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.731032    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:11.749713 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.749684    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal"]
Sep 10 19:20:11.749789 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.749753    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:20:11.751095 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.751081    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:20:11.751148 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.751109    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:20:11.751148 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.751119    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:20:11.752254 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752243    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:20:11.752434 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.752491 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752449    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:20:11.752951 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752933    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:20:11.752951 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752942    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:20:11.753057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752961    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:20:11.753057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752964    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:20:11.753057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752971    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:20:11.753057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.752974    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:20:11.754167 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.754155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.754203 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.754177    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:20:11.754844 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.754817    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-149.ec2.internal\" not found" node="ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.754917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.754869    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:20:11.754917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.754895    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:20:11.754917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.754908    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:20:11.774990 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.774969    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-149.ec2.internal\" not found" node="ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.779200 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.779185    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-149.ec2.internal\" not found" node="ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.830511 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.830488    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 19:20:11.831337 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.831322    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 19:20:11.831433 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.831350    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 19:20:11.831433 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.831360    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeHasSufficientPID"
Sep 10 19:20:11.831433 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.831398    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.837636 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.837622    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.837678 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.837643    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-149.ec2.internal\": node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:11.845366 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.845342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19769de7a52a4b16d72b8608653b935d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal\" (UID: \"19769de7a52a4b16d72b8608653b935d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.845451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.845365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19769de7a52a4b16d72b8608653b935d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal\" (UID: \"19769de7a52a4b16d72b8608653b935d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.845451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.845394    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3c9811dd99e57f23a5e3fa521a13acb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-149.ec2.internal\" (UID: \"c3c9811dd99e57f23a5e3fa521a13acb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.851665 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.851649    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:11.945696 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.945668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19769de7a52a4b16d72b8608653b935d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal\" (UID: \"19769de7a52a4b16d72b8608653b935d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.945789 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.945714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3c9811dd99e57f23a5e3fa521a13acb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-149.ec2.internal\" (UID: \"c3c9811dd99e57f23a5e3fa521a13acb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.945789 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.945731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19769de7a52a4b16d72b8608653b935d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal\" (UID: \"19769de7a52a4b16d72b8608653b935d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.945789 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.945758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19769de7a52a4b16d72b8608653b935d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal\" (UID: \"19769de7a52a4b16d72b8608653b935d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.945878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.945791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19769de7a52a4b16d72b8608653b935d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal\" (UID: \"19769de7a52a4b16d72b8608653b935d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.945878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:11.945761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3c9811dd99e57f23a5e3fa521a13acb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-149.ec2.internal\" (UID: \"c3c9811dd99e57f23a5e3fa521a13acb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:11.951710 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:11.951691    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:12.052586 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:12.052525    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:12.076709 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.076681    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:12.082342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.082327    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:12.153041 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:12.153009    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:12.253466 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:12.253435    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:12.353842 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:12.353778    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:12.421154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.421123    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:20:12.454458 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:12.454434    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-149.ec2.internal\" not found"
Sep 10 19:20:12.487569 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.487551    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 19:20:12.487919 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.487672    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 19:20:12.487919 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.487694    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 19:20:12.549953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.549920    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 19:15:11 +0000 UTC" deadline="2028-04-02 20:01:09.154830265 +0000 UTC"
Sep 10 19:20:12.549953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.549945    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13680h40m56.604888543s"
Sep 10 19:20:12.554132 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.554116    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:20:12.643772 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.643576    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:12.655529 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.655506    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 19:20:12.656382 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.656351    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal"
Sep 10 19:20:12.664208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.664188    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 19:20:12.713116 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:12.713092    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19769de7a52a4b16d72b8608653b935d.slice/crio-ec5228418a0fa6db8b76bcf713f508629e84761a7f459bda34a8b704a7e9b5ec WatchSource:0}: Error finding container ec5228418a0fa6db8b76bcf713f508629e84761a7f459bda34a8b704a7e9b5ec: Status 404 returned error can't find the container with id ec5228418a0fa6db8b76bcf713f508629e84761a7f459bda34a8b704a7e9b5ec
Sep 10 19:20:12.713387 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:12.713355    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c9811dd99e57f23a5e3fa521a13acb.slice/crio-8671fb9f41c93317c7bf16effad38004ddcfec24e68dfde41bffe71f3f3ca447 WatchSource:0}: Error finding container 8671fb9f41c93317c7bf16effad38004ddcfec24e68dfde41bffe71f3f3ca447: Status 404 returned error can't find the container with id 8671fb9f41c93317c7bf16effad38004ddcfec24e68dfde41bffe71f3f3ca447
Sep 10 19:20:12.718421 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:12.718407    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:20:13.021870 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.021806    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:20:13.523340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.523309    2558 apiserver.go:52] "Watching apiserver"
Sep 10 19:20:13.530639 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.530488    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 19:20:13.530861 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.530834    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-xfvmr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j","openshift-dns/node-resolver-9ctcv","openshift-image-registry/node-ca-29wfz","openshift-multus/multus-additional-cni-plugins-9dtz9","openshift-multus/multus-brqzm","openshift-multus/network-metrics-daemon-p2bq2","openshift-network-diagnostics/network-check-target-8btsb","kube-system/global-pull-secret-syncer-kwds8","kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8xx7n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal","openshift-network-operator/iptables-alerter-6gnlj","openshift-ovn-kubernetes/ovnkube-node-q28s2"]
Sep 10 19:20:13.532183 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.532155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:13.532293 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.532232    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:13.533364 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.533223    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.534247 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.534225    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.535239 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.535219    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 19:20:13.535445 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.535431    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:20:13.535657 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.535642    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqwr5\""
Sep 10 19:20:13.535960 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.535936    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 19:20:13.536230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.536216    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 19:20:13.536445 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.536430    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-phmnk\""
Sep 10 19:20:13.536878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.536844    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 19:20:13.537028 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.537015    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.537119 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.537063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.537655 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.537639    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.538905 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.538607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.538905 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.538661    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:13.538905 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.538752    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539169    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539198    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539410    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539641    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539692    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nv5lh\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539722    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539646    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2g28\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539884    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539903    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.539914    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.540009    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-th4lz\""
Sep 10 19:20:13.540230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.540107    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 19:20:13.541604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.540984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.542015 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.541997    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 19:20:13.542090 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.542028    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-46q5h\""
Sep 10 19:20:13.542090 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.542047    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 19:20:13.543002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.542929    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 19:20:13.543970 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.543954    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.544609 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.544588    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 19:20:13.544692 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.544625    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 19:20:13.544692 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.544632    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rdwrv\""
Sep 10 19:20:13.544879 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.544864    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 19:20:13.545576 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.545214    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.546089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.546071    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 19:20:13.546267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.546254    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xmln5\""
Sep 10 19:20:13.546581 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.546564    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:13.546661 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.546614    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:13.546720 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.546708    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 19:20:13.546767 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.546750    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 19:20:13.547037 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.547020    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 19:20:13.547097 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.547060    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 19:20:13.547434 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.547402    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 19:20:13.547618 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.547601    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:20:13.547678 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.547649    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-79rnn\""
Sep 10 19:20:13.547758 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.547609    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 19:20:13.552704 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.552685    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 19:20:13.556415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556053    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-tmp-dir\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.556501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-var-lib-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.556501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556463    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovn-node-metrics-cert\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.556501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57ccd984-a453-4cd9-976d-fc0baf29af98-serviceca\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.556632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.556632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-kubelet\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.556632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-env-overrides\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.556632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cnibin\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.556790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-kubelet-config\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.556931 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-dbus\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.556978 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-slash\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.557024 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.556988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:13.557072 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/937aa937-ea34-4d44-905e-e51593683d06-multus-daemon-config\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.557072 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.557154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-systemd\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.557154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.557236 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-cni-multus\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.557236 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-kubelet\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.557329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-cni-netd\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.557329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfb9d\" (UniqueName: \"kubernetes.io/projected/30dda39a-f601-4b21-a352-6875d28350f8-kube-api-access-gfb9d\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:13.557329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/937aa937-ea34-4d44-905e-e51593683d06-cni-binary-copy\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.557477 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovnkube-config\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.557548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvcr\" (UniqueName: \"kubernetes.io/projected/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-kube-api-access-6kvcr\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.557612 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.557656 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-netns\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.557704 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-conf-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.557752 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557702    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-cni-bin\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.557752 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557740    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-iptables-alerter-script\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.558022 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjgj5\" (UniqueName: \"kubernetes.io/projected/57ccd984-a453-4cd9-976d-fc0baf29af98-kube-api-access-zjgj5\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.558022 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-system-cni-dir\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.558022 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-systemd-units\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.558022 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57ccd984-a453-4cd9-976d-fc0baf29af98-host\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.558022 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.557985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-cni-bin\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.558212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvnnf\" (UniqueName: \"kubernetes.io/projected/937aa937-ea34-4d44-905e-e51593683d06-kube-api-access-mvnnf\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.558212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx25b\" (UniqueName: \"kubernetes.io/projected/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-kube-api-access-cx25b\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.558212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558089    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-run-netns\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.558212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.558212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-system-cni-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.558212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-hostroot\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.558437 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-hosts-file\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.558437 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-etc-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.558437 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovnkube-script-lib\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.558530 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.558365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.559641 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-cni-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.559720 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-cnibin\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.559720 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-k8s-cni-cncf-io\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.559813 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-socket-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.559813 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559755    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-sys-fs\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.559813 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwn9k\" (UniqueName: \"kubernetes.io/projected/2a070e62-4c11-49e0-ac69-7cff4cc31e40-kube-api-access-bwn9k\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.559995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.559995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559855    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-socket-dir-parent\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.559995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-multus-certs\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.559995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-run-ovn-kubernetes\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.559995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-device-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.559995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-node-log\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.560233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.559999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-log-socket\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.560233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560025    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8153f3b3-cd4d-4ac4-b808-5fadb4937044-agent-certs\") pod \"konnectivity-agent-xfvmr\" (UID: \"8153f3b3-cd4d-4ac4-b808-5fadb4937044\") " pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.560233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.560233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz9h5\" (UniqueName: \"kubernetes.io/projected/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-kube-api-access-dz9h5\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.560233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-etc-kubernetes\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.560233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.560524 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560226    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8153f3b3-cd4d-4ac4-b808-5fadb4937044-konnectivity-ca\") pod \"konnectivity-agent-xfvmr\" (UID: \"8153f3b3-cd4d-4ac4-b808-5fadb4937044\") " pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.560611 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-registration-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.560657 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-ovn\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.560703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-host-slash\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.560811 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.560713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8fr7\" (UniqueName: \"kubernetes.io/projected/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-kube-api-access-z8fr7\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.578459 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.578439    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sjbz5"
Sep 10 19:20:13.585255 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.585226    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sjbz5"
Sep 10 19:20:13.644333 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.644305    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 19:20:13.653523 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.653476    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal" event={"ID":"19769de7a52a4b16d72b8608653b935d","Type":"ContainerStarted","Data":"ec5228418a0fa6db8b76bcf713f508629e84761a7f459bda34a8b704a7e9b5ec"}
Sep 10 19:20:13.654980 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.654958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal" event={"ID":"c3c9811dd99e57f23a5e3fa521a13acb","Type":"ContainerStarted","Data":"8671fb9f41c93317c7bf16effad38004ddcfec24e68dfde41bffe71f3f3ca447"}
Sep 10 19:20:13.661322 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-var-lib-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.661454 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovn-node-metrics-cert\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.661454 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57ccd984-a453-4cd9-976d-fc0baf29af98-serviceca\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.661454 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661394    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-var-lib-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.661454 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.661664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-kubelet\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.661664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-env-overrides\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.661664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cnibin\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.661664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-kubelet-config\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.661664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-dbus\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.661664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661612    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-kubelet\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.661664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9178dbef-7583-4882-b72b-d139584956ac-etc-tuned\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9178dbef-7583-4882-b72b-d139584956ac-tmp\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-slash\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/937aa937-ea34-4d44-905e-e51593683d06-multus-daemon-config\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-modprobe-d\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57ccd984-a453-4cd9-976d-fc0baf29af98-serviceca\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-systemd\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661906    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-var-lib-kubelet\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-cni-multus\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysconfig\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.661982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.661977    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-kubernetes\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662005    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-kubelet\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-cni-netd\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfb9d\" (UniqueName: \"kubernetes.io/projected/30dda39a-f601-4b21-a352-6875d28350f8-kube-api-access-gfb9d\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/937aa937-ea34-4d44-905e-e51593683d06-cni-binary-copy\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-sys\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-lib-modules\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovnkube-config\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662222    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvcr\" (UniqueName: \"kubernetes.io/projected/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-kube-api-access-6kvcr\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-netns\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-cni-multus\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-env-overrides\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-conf-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.662673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-slash\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.663346 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/937aa937-ea34-4d44-905e-e51593683d06-cni-binary-copy\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.663346 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.662961    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/937aa937-ea34-4d44-905e-e51593683d06-multus-daemon-config\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.663346 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.663346 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.663144    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:13.663346 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-systemd\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.663346 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.663281    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs podName:30dda39a-f601-4b21-a352-6875d28350f8 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:14.163261165 +0000 UTC m=+2.979870712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs") pod "network-metrics-daemon-p2bq2" (UID: "30dda39a-f601-4b21-a352-6875d28350f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cnibin\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-dbus\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-kubelet-config\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663520    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-cni-netd\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663538    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663556    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-conf-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-netns\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663630    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-kubelet\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663686    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-cni-bin\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.663716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-cni-bin\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-iptables-alerter-script\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjgj5\" (UniqueName: \"kubernetes.io/projected/57ccd984-a453-4cd9-976d-fc0baf29af98-kube-api-access-zjgj5\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-system-cni-dir\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.663982    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovnkube-config\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664043    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-systemd-units\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57ccd984-a453-4cd9-976d-fc0baf29af98-host\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-systemd-units\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-system-cni-dir\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-cni-bin\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvnnf\" (UniqueName: \"kubernetes.io/projected/937aa937-ea34-4d44-905e-e51593683d06-kube-api-access-mvnnf\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx25b\" (UniqueName: \"kubernetes.io/projected/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-kube-api-access-cx25b\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57ccd984-a453-4cd9-976d-fc0baf29af98-host\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-iptables-alerter-script\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.664304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysctl-d\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-var-lib-cni-bin\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-run\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-run-netns\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-run-netns\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-system-cni-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-hostroot\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-host\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664592    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-hostroot\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-hosts-file\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664623    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-system-cni-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-etc-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-hosts-file\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovnkube-script-lib\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-etc-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-cni-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.664977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-cnibin\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-cni-dir\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-k8s-cni-cncf-io\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665169    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-cnibin\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-socket-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-k8s-cni-cncf-io\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-sys-fs\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwn9k\" (UniqueName: \"kubernetes.io/projected/2a070e62-4c11-49e0-ac69-7cff4cc31e40-kube-api-access-bwn9k\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-socket-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovnkube-script-lib\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-openvswitch\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665341    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-socket-dir-parent\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-multus-socket-dir-parent\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.665884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-sys-fs\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-multus-certs\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-host-run-multus-certs\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-run-ovn-kubernetes\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-host-run-ovn-kubernetes\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-device-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-device-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-node-log\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-log-socket\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysctl-conf\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8153f3b3-cd4d-4ac4-b808-5fadb4937044-agent-certs\") pod \"konnectivity-agent-xfvmr\" (UID: \"8153f3b3-cd4d-4ac4-b808-5fadb4937044\") " pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9h5\" (UniqueName: \"kubernetes.io/projected/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-kube-api-access-dz9h5\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-etc-kubernetes\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8153f3b3-cd4d-4ac4-b808-5fadb4937044-konnectivity-ca\") pod \"konnectivity-agent-xfvmr\" (UID: \"8153f3b3-cd4d-4ac4-b808-5fadb4937044\") " pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.665990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-registration-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.666762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-ovn\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-host-slash\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8fr7\" (UniqueName: \"kubernetes.io/projected/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-kube-api-access-z8fr7\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-systemd\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mstpt\" (UniqueName: \"kubernetes.io/projected/9178dbef-7583-4882-b72b-d139584956ac-kube-api-access-mstpt\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-node-log\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666198    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937aa937-ea34-4d44-905e-e51593683d06-etc-kubernetes\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-log-socket\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-run-ovn\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666494    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-tmp-dir\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666527    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-ovn-node-metrics-cert\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.666592    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a070e62-4c11-49e0-ac69-7cff4cc31e40-registration-dir\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.666720    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret podName:d73d1992-e3e8-46c7-9a80-ee3a2fb672ea nodeName:}" failed. No retries permitted until 2026-09-10 19:20:14.166702801 +0000 UTC m=+2.983312349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret") pod "global-pull-secret-syncer-kwds8" (UID: "d73d1992-e3e8-46c7-9a80-ee3a2fb672ea") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-host-slash\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.666833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-tmp-dir\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.667653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.667085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8153f3b3-cd4d-4ac4-b808-5fadb4937044-konnectivity-ca\") pod \"konnectivity-agent-xfvmr\" (UID: \"8153f3b3-cd4d-4ac4-b808-5fadb4937044\") " pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.668735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.668710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8153f3b3-cd4d-4ac4-b808-5fadb4937044-agent-certs\") pod \"konnectivity-agent-xfvmr\" (UID: \"8153f3b3-cd4d-4ac4-b808-5fadb4937044\") " pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.674187 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.674100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfb9d\" (UniqueName: \"kubernetes.io/projected/30dda39a-f601-4b21-a352-6875d28350f8-kube-api-access-gfb9d\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:13.674956 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.674931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjgj5\" (UniqueName: \"kubernetes.io/projected/57ccd984-a453-4cd9-976d-fc0baf29af98-kube-api-access-zjgj5\") pod \"node-ca-29wfz\" (UID: \"57ccd984-a453-4cd9-976d-fc0baf29af98\") " pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.678549 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.677858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvnnf\" (UniqueName: \"kubernetes.io/projected/937aa937-ea34-4d44-905e-e51593683d06-kube-api-access-mvnnf\") pod \"multus-brqzm\" (UID: \"937aa937-ea34-4d44-905e-e51593683d06\") " pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.678549 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.678182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9h5\" (UniqueName: \"kubernetes.io/projected/74ae1e88-a0b8-47a5-8b6f-370dda453fc9-kube-api-access-dz9h5\") pod \"ovnkube-node-q28s2\" (UID: \"74ae1e88-a0b8-47a5-8b6f-370dda453fc9\") " pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:13.678549 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.678272    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvcr\" (UniqueName: \"kubernetes.io/projected/022dee1a-e44d-46ca-8ab8-e7521ffbca9e-kube-api-access-6kvcr\") pod \"iptables-alerter-6gnlj\" (UID: \"022dee1a-e44d-46ca-8ab8-e7521ffbca9e\") " pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.678549 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.678495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8fr7\" (UniqueName: \"kubernetes.io/projected/0c3158c3-0333-44c0-8738-9a83ad1bb0d1-kube-api-access-z8fr7\") pod \"multus-additional-cni-plugins-9dtz9\" (UID: \"0c3158c3-0333-44c0-8738-9a83ad1bb0d1\") " pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.678795 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.678691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx25b\" (UniqueName: \"kubernetes.io/projected/b0bfcc8d-58a9-408d-ad9c-afc9c437964e-kube-api-access-cx25b\") pod \"node-resolver-9ctcv\" (UID: \"b0bfcc8d-58a9-408d-ad9c-afc9c437964e\") " pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.682640 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.682617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwn9k\" (UniqueName: \"kubernetes.io/projected/2a070e62-4c11-49e0-ac69-7cff4cc31e40-kube-api-access-bwn9k\") pod \"aws-ebs-csi-driver-node-l5f4j\" (UID: \"2a070e62-4c11-49e0-ac69-7cff4cc31e40\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.718006 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.717972    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:20:13.767027 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.766987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-systemd\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767027 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767026    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstpt\" (UniqueName: \"kubernetes.io/projected/9178dbef-7583-4882-b72b-d139584956ac-kube-api-access-mstpt\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9178dbef-7583-4882-b72b-d139584956ac-etc-tuned\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9178dbef-7583-4882-b72b-d139584956ac-tmp\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-modprobe-d\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-systemd\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-var-lib-kubelet\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysconfig\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-kubernetes\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-sys\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-lib-modules\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-kubernetes\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-sys\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-var-lib-kubelet\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysctl-d\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-run\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysconfig\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-modprobe-d\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767454    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-host\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-lib-modules\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysctl-conf\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-run\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767556    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysctl-d\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-host\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.767706 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.767621    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9178dbef-7583-4882-b72b-d139584956ac-etc-sysctl-conf\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.769538 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.769513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9178dbef-7583-4882-b72b-d139584956ac-tmp\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.769662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.769629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9178dbef-7583-4882-b72b-d139584956ac-etc-tuned\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.772986 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.772966    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:20:13.773072 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.772996    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:20:13.773072 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.773007    2558 projected.go:196] Error preparing data for projected volume kube-api-access-rpx5l for pod openshift-network-diagnostics/network-check-target-8btsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:13.773072 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:13.773056    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l podName:303175c3-e49f-4cdc-bf40-73d0a90e2341 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:14.273038305 +0000 UTC m=+3.089647850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rpx5l" (UniqueName: "kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l") pod "network-check-target-8btsb" (UID: "303175c3-e49f-4cdc-bf40-73d0a90e2341") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:13.775175 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.775121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mstpt\" (UniqueName: \"kubernetes.io/projected/9178dbef-7583-4882-b72b-d139584956ac-kube-api-access-mstpt\") pod \"tuned-8xx7n\" (UID: \"9178dbef-7583-4882-b72b-d139584956ac\") " pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.849383 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.849337    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6gnlj"
Sep 10 19:20:13.854345 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.854326    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9ctcv"
Sep 10 19:20:13.862933 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.862907    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xx7n"
Sep 10 19:20:13.868847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.868827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-29wfz"
Sep 10 19:20:13.875403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.875382    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9dtz9"
Sep 10 19:20:13.881232 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.881207    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-brqzm"
Sep 10 19:20:13.888829 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.888810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:13.894493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.894471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j"
Sep 10 19:20:13.900123 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:13.900105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:14.170280 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.170198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:14.170280 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.170243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:14.170518 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.170361    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:14.170518 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.170444    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs podName:30dda39a-f601-4b21-a352-6875d28350f8 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:15.170427062 +0000 UTC m=+3.987036608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs") pod "network-metrics-daemon-p2bq2" (UID: "30dda39a-f601-4b21-a352-6875d28350f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:14.170518 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.170363    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:14.170643 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.170524    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret podName:d73d1992-e3e8-46c7-9a80-ee3a2fb672ea nodeName:}" failed. No retries permitted until 2026-09-10 19:20:15.170511996 +0000 UTC m=+3.987121565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret") pod "global-pull-secret-syncer-kwds8" (UID: "d73d1992-e3e8-46c7-9a80-ee3a2fb672ea") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:14.372319 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.372283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:14.372498 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.372463    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:20:14.372498 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.372488    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:20:14.372498 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.372498    2558 projected.go:196] Error preparing data for projected volume kube-api-access-rpx5l for pod openshift-network-diagnostics/network-check-target-8btsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:14.372619 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:14.372558    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l podName:303175c3-e49f-4cdc-bf40-73d0a90e2341 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:15.372540378 +0000 UTC m=+4.189149924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpx5l" (UniqueName: "kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l") pod "network-check-target-8btsb" (UID: "303175c3-e49f-4cdc-bf40-73d0a90e2341") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:14.501696 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.501608    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 19:20:14.587827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.587796    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 19:15:13 +0000 UTC" deadline="2028-05-12 23:30:25.869842157 +0000 UTC"
Sep 10 19:20:14.587827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.587821    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14644h10m11.282024459s"
Sep 10 19:20:14.592001 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.591970    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022dee1a_e44d_46ca_8ab8_e7521ffbca9e.slice/crio-77b95aec7ad6203d48d2ee8fb760896dbd48dad2c94a159d3ec90a4cdf70d4ed WatchSource:0}: Error finding container 77b95aec7ad6203d48d2ee8fb760896dbd48dad2c94a159d3ec90a4cdf70d4ed: Status 404 returned error can't find the container with id 77b95aec7ad6203d48d2ee8fb760896dbd48dad2c94a159d3ec90a4cdf70d4ed
Sep 10 19:20:14.594477 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.594449    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8153f3b3_cd4d_4ac4_b808_5fadb4937044.slice/crio-188e11aa6560a8c6cbaf85d15aaaaf8d65092eede5f5ecd58e40ce41d210f9f8 WatchSource:0}: Error finding container 188e11aa6560a8c6cbaf85d15aaaaf8d65092eede5f5ecd58e40ce41d210f9f8: Status 404 returned error can't find the container with id 188e11aa6560a8c6cbaf85d15aaaaf8d65092eede5f5ecd58e40ce41d210f9f8
Sep 10 19:20:14.597209 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.597173    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3158c3_0333_44c0_8738_9a83ad1bb0d1.slice/crio-970d0004fc2cdff4f4311e388b1afc1b1cdeb535017893284e8d54e9e4926a3e WatchSource:0}: Error finding container 970d0004fc2cdff4f4311e388b1afc1b1cdeb535017893284e8d54e9e4926a3e: Status 404 returned error can't find the container with id 970d0004fc2cdff4f4311e388b1afc1b1cdeb535017893284e8d54e9e4926a3e
Sep 10 19:20:14.597845 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.597755    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a070e62_4c11_49e0_ac69_7cff4cc31e40.slice/crio-988e9b5e7437f1bdafa704665d898214e72cfbc2434bebce90dbab873d9a25ba WatchSource:0}: Error finding container 988e9b5e7437f1bdafa704665d898214e72cfbc2434bebce90dbab873d9a25ba: Status 404 returned error can't find the container with id 988e9b5e7437f1bdafa704665d898214e72cfbc2434bebce90dbab873d9a25ba
Sep 10 19:20:14.598712 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.598499    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937aa937_ea34_4d44_905e_e51593683d06.slice/crio-f1563e7900f00732afdda34f28af475f07e4880aefc9e0553c553ff243ccf90d WatchSource:0}: Error finding container f1563e7900f00732afdda34f28af475f07e4880aefc9e0553c553ff243ccf90d: Status 404 returned error can't find the container with id f1563e7900f00732afdda34f28af475f07e4880aefc9e0553c553ff243ccf90d
Sep 10 19:20:14.599930 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.599909    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ccd984_a453_4cd9_976d_fc0baf29af98.slice/crio-2dd4ef46e8642ed913428be9b70e1324fecdcf5c59e2c789069c53004d6518a5 WatchSource:0}: Error finding container 2dd4ef46e8642ed913428be9b70e1324fecdcf5c59e2c789069c53004d6518a5: Status 404 returned error can't find the container with id 2dd4ef46e8642ed913428be9b70e1324fecdcf5c59e2c789069c53004d6518a5
Sep 10 19:20:14.601956 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.601922    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ae1e88_a0b8_47a5_8b6f_370dda453fc9.slice/crio-f774662fa99cc772218585eb0d84cbc4c95103aa02b3befcad36428e66b2d7a2 WatchSource:0}: Error finding container f774662fa99cc772218585eb0d84cbc4c95103aa02b3befcad36428e66b2d7a2: Status 404 returned error can't find the container with id f774662fa99cc772218585eb0d84cbc4c95103aa02b3befcad36428e66b2d7a2
Sep 10 19:20:14.602701 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.602671    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0bfcc8d_58a9_408d_ad9c_afc9c437964e.slice/crio-30801008e10212724c0171a1391e5f999b351f0ee4081bc050bfe8bbed541d13 WatchSource:0}: Error finding container 30801008e10212724c0171a1391e5f999b351f0ee4081bc050bfe8bbed541d13: Status 404 returned error can't find the container with id 30801008e10212724c0171a1391e5f999b351f0ee4081bc050bfe8bbed541d13
Sep 10 19:20:14.603679 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:14.603494    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9178dbef_7583_4882_b72b_d139584956ac.slice/crio-89c8492b1b357abd224d9af48b37e5f47f38525a2a75e0e1da41c71d93c8a21a WatchSource:0}: Error finding container 89c8492b1b357abd224d9af48b37e5f47f38525a2a75e0e1da41c71d93c8a21a: Status 404 returned error can't find the container with id 89c8492b1b357abd224d9af48b37e5f47f38525a2a75e0e1da41c71d93c8a21a
Sep 10 19:20:14.658971 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.658942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerStarted","Data":"970d0004fc2cdff4f4311e388b1afc1b1cdeb535017893284e8d54e9e4926a3e"}
Sep 10 19:20:14.660091 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.660063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xfvmr" event={"ID":"8153f3b3-cd4d-4ac4-b808-5fadb4937044","Type":"ContainerStarted","Data":"188e11aa6560a8c6cbaf85d15aaaaf8d65092eede5f5ecd58e40ce41d210f9f8"}
Sep 10 19:20:14.661344 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.661319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xx7n" event={"ID":"9178dbef-7583-4882-b72b-d139584956ac","Type":"ContainerStarted","Data":"89c8492b1b357abd224d9af48b37e5f47f38525a2a75e0e1da41c71d93c8a21a"}
Sep 10 19:20:14.662507 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.662483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9ctcv" event={"ID":"b0bfcc8d-58a9-408d-ad9c-afc9c437964e","Type":"ContainerStarted","Data":"30801008e10212724c0171a1391e5f999b351f0ee4081bc050bfe8bbed541d13"}
Sep 10 19:20:14.663647 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.663622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"f774662fa99cc772218585eb0d84cbc4c95103aa02b3befcad36428e66b2d7a2"}
Sep 10 19:20:14.664809 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.664787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6gnlj" event={"ID":"022dee1a-e44d-46ca-8ab8-e7521ffbca9e","Type":"ContainerStarted","Data":"77b95aec7ad6203d48d2ee8fb760896dbd48dad2c94a159d3ec90a4cdf70d4ed"}
Sep 10 19:20:14.665962 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.665938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-29wfz" event={"ID":"57ccd984-a453-4cd9-976d-fc0baf29af98","Type":"ContainerStarted","Data":"2dd4ef46e8642ed913428be9b70e1324fecdcf5c59e2c789069c53004d6518a5"}
Sep 10 19:20:14.667741 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.667697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-brqzm" event={"ID":"937aa937-ea34-4d44-905e-e51593683d06","Type":"ContainerStarted","Data":"f1563e7900f00732afdda34f28af475f07e4880aefc9e0553c553ff243ccf90d"}
Sep 10 19:20:14.669311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:14.669290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j" event={"ID":"2a070e62-4c11-49e0-ac69-7cff4cc31e40","Type":"ContainerStarted","Data":"988e9b5e7437f1bdafa704665d898214e72cfbc2434bebce90dbab873d9a25ba"}
Sep 10 19:20:15.177615 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.177350    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:15.177615 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.177435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:15.177615 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.177538    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:15.177615 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.177582    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:15.177615 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.177616    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret podName:d73d1992-e3e8-46c7-9a80-ee3a2fb672ea nodeName:}" failed. No retries permitted until 2026-09-10 19:20:17.17759401 +0000 UTC m=+5.994203570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret") pod "global-pull-secret-syncer-kwds8" (UID: "d73d1992-e3e8-46c7-9a80-ee3a2fb672ea") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:15.177975 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.177638    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs podName:30dda39a-f601-4b21-a352-6875d28350f8 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:17.177627 +0000 UTC m=+5.994236558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs") pod "network-metrics-daemon-p2bq2" (UID: "30dda39a-f601-4b21-a352-6875d28350f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:15.378594 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.378553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:15.378769 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.378738    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:20:15.378769 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.378763    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:20:15.378872 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.378778    2558 projected.go:196] Error preparing data for projected volume kube-api-access-rpx5l for pod openshift-network-diagnostics/network-check-target-8btsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:15.378872 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.378836    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l podName:303175c3-e49f-4cdc-bf40-73d0a90e2341 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:17.37881804 +0000 UTC m=+6.195427592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpx5l" (UniqueName: "kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l") pod "network-check-target-8btsb" (UID: "303175c3-e49f-4cdc-bf40-73d0a90e2341") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:15.589086 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.588969    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 19:15:13 +0000 UTC" deadline="2028-04-06 17:37:10.639629919 +0000 UTC"
Sep 10 19:20:15.589086 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.589034    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13774h16m55.050600389s"
Sep 10 19:20:15.651746 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.651672    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:15.651746 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.651722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:15.651998 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.651687    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:15.651998 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.651812    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:15.651998 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.651973    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:15.652150 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:15.652065    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:15.685284 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.685246    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal" event={"ID":"c3c9811dd99e57f23a5e3fa521a13acb","Type":"ContainerStarted","Data":"15822eaf39b4e7dd3318532b153b58fcdce71622b1922e8a720fc6457c3531cc"}
Sep 10 19:20:15.696904 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.696864    2558 generic.go:356] "Generic (PLEG): container finished" podID="19769de7a52a4b16d72b8608653b935d" containerID="4b7421b63e35b8319ca5103d0d54ed7fdf0ff1fef2ae264fc2a20cd4a1de48a8" exitCode=0
Sep 10 19:20:15.696904 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.696907    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal" event={"ID":"19769de7a52a4b16d72b8608653b935d","Type":"ContainerDied","Data":"4b7421b63e35b8319ca5103d0d54ed7fdf0ff1fef2ae264fc2a20cd4a1de48a8"}
Sep 10 19:20:15.719556 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:15.719399    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-149.ec2.internal" podStartSLOduration=3.719361401 podStartE2EDuration="3.719361401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:15.704182519 +0000 UTC m=+4.520792105" watchObservedRunningTime="2026-09-10 19:20:15.719361401 +0000 UTC m=+4.535970970"
Sep 10 19:20:16.713827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:16.713544    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal" event={"ID":"19769de7a52a4b16d72b8608653b935d","Type":"ContainerStarted","Data":"871068f35d421320710c634364b061ddf56e3bc7551804805a44f7c46508a7f8"}
Sep 10 19:20:17.195301 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:17.195243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:17.195301 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:17.195306    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:17.195601 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.195477    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:17.195601 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.195538    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs podName:30dda39a-f601-4b21-a352-6875d28350f8 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:21.195519757 +0000 UTC m=+10.012129325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs") pod "network-metrics-daemon-p2bq2" (UID: "30dda39a-f601-4b21-a352-6875d28350f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:17.195957 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.195936    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:17.196038 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.195994    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret podName:d73d1992-e3e8-46c7-9a80-ee3a2fb672ea nodeName:}" failed. No retries permitted until 2026-09-10 19:20:21.195977288 +0000 UTC m=+10.012586848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret") pod "global-pull-secret-syncer-kwds8" (UID: "d73d1992-e3e8-46c7-9a80-ee3a2fb672ea") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:17.396896 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:17.396857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:17.397101 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.397082    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:20:17.397168 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.397112    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:20:17.397168 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.397125    2558 projected.go:196] Error preparing data for projected volume kube-api-access-rpx5l for pod openshift-network-diagnostics/network-check-target-8btsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:17.397274 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.397185    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l podName:303175c3-e49f-4cdc-bf40-73d0a90e2341 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:21.397165992 +0000 UTC m=+10.213775551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpx5l" (UniqueName: "kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l") pod "network-check-target-8btsb" (UID: "303175c3-e49f-4cdc-bf40-73d0a90e2341") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:17.650745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:17.649953    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:17.650745 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.650102    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:17.650745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:17.650536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:17.650745 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.650624    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:17.651255 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:17.651089    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:17.651255 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:17.651177    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:19.649308 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:19.649271    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:19.649777 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:19.649424    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:19.649777 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:19.649483    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:19.649777 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:19.649583    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:19.649777 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:19.649667    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:19.649777 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:19.649750    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:21.228226 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:21.228156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:21.228226 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:21.228194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:21.228739 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.228299    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:21.228739 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.228343    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs podName:30dda39a-f601-4b21-a352-6875d28350f8 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:29.228329768 +0000 UTC m=+18.044939314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs") pod "network-metrics-daemon-p2bq2" (UID: "30dda39a-f601-4b21-a352-6875d28350f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:21.228739 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.228726    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:21.228910 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.228773    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret podName:d73d1992-e3e8-46c7-9a80-ee3a2fb672ea nodeName:}" failed. No retries permitted until 2026-09-10 19:20:29.228758947 +0000 UTC m=+18.045368500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret") pod "global-pull-secret-syncer-kwds8" (UID: "d73d1992-e3e8-46c7-9a80-ee3a2fb672ea") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:21.430525 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:21.430488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:21.430687 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.430637    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:20:21.430687 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.430657    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:20:21.430687 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.430667    2558 projected.go:196] Error preparing data for projected volume kube-api-access-rpx5l for pod openshift-network-diagnostics/network-check-target-8btsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:21.430853 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.430717    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l podName:303175c3-e49f-4cdc-bf40-73d0a90e2341 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:29.430701057 +0000 UTC m=+18.247310605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpx5l" (UniqueName: "kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l") pod "network-check-target-8btsb" (UID: "303175c3-e49f-4cdc-bf40-73d0a90e2341") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:21.650175 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:21.650082    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:21.650326 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.650205    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:21.650484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:21.650448    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:21.650634 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.650560    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:21.650634 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:21.650606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:21.650755 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:21.650677    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:23.649684 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:23.649647    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:23.650128 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:23.649649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:23.650128 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:23.649776    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:23.650128 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:23.649813    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:23.650128 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:23.649914    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:23.650128 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:23.649988    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:25.649310 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:25.649276    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:25.649735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:25.649276    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:25.649735 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:25.649410    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:25.649735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:25.649432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:25.649735 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:25.649557    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:25.649735 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:25.649671    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:27.649758 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:27.649721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:27.650166 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:27.649721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:27.650166 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:27.649855    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:27.650166 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:27.649945    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:27.650166 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:27.649721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:27.650166 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:27.650044    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:29.289794 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:29.289758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:29.290339 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:29.289829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:29.290339 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.289910    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:29.290339 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.289922    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:29.290339 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.289969    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret podName:d73d1992-e3e8-46c7-9a80-ee3a2fb672ea nodeName:}" failed. No retries permitted until 2026-09-10 19:20:45.289949291 +0000 UTC m=+34.106558840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret") pod "global-pull-secret-syncer-kwds8" (UID: "d73d1992-e3e8-46c7-9a80-ee3a2fb672ea") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:29.290339 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.289987    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs podName:30dda39a-f601-4b21-a352-6875d28350f8 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:45.289977834 +0000 UTC m=+34.106587383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs") pod "network-metrics-daemon-p2bq2" (UID: "30dda39a-f601-4b21-a352-6875d28350f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:29.491542 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:29.491504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:29.491713 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.491678    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:20:29.491713 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.491701    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:20:29.491713 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.491713    2558 projected.go:196] Error preparing data for projected volume kube-api-access-rpx5l for pod openshift-network-diagnostics/network-check-target-8btsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:29.491841 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.491774    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l podName:303175c3-e49f-4cdc-bf40-73d0a90e2341 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:45.491756199 +0000 UTC m=+34.308365760 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpx5l" (UniqueName: "kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l") pod "network-check-target-8btsb" (UID: "303175c3-e49f-4cdc-bf40-73d0a90e2341") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:29.649635 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:29.649557    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:29.649799 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:29.649562    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:29.649799 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.649674    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:29.649799 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:29.649571    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:29.649799 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.649757    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:29.650011 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:29.649859    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:31.650392 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:31.650339    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:31.650865 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:31.650446    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:31.650865 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:31.650460    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:31.650865 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:31.650485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:31.650865 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:31.650586    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:31.650865 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:31.650652    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:32.749595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.749181    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j" event={"ID":"2a070e62-4c11-49e0-ac69-7cff4cc31e40","Type":"ContainerStarted","Data":"c2eeee7cf2610a511c872dc494360141387c422b4c77fea0dd231317217ca01f"}
Sep 10 19:20:32.750901 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.750879    2558 generic.go:356] "Generic (PLEG): container finished" podID="0c3158c3-0333-44c0-8738-9a83ad1bb0d1" containerID="9d2d7218b9c117441c77be292e09105c37701f6817de7b966f34686ddf37bbc1" exitCode=0
Sep 10 19:20:32.751007 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.750947    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerDied","Data":"9d2d7218b9c117441c77be292e09105c37701f6817de7b966f34686ddf37bbc1"}
Sep 10 19:20:32.752528 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.752506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xfvmr" event={"ID":"8153f3b3-cd4d-4ac4-b808-5fadb4937044","Type":"ContainerStarted","Data":"2b7279f939dacbfd26b374cb0f87a102d83889562be77674484ad0cd31f5e579"}
Sep 10 19:20:32.754162 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.754134    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xx7n" event={"ID":"9178dbef-7583-4882-b72b-d139584956ac","Type":"ContainerStarted","Data":"4219e77c311cc20042a81141b329b04844e543131cc6f9f465222cedfaffcf95"}
Sep 10 19:20:32.755810 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.755765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9ctcv" event={"ID":"b0bfcc8d-58a9-408d-ad9c-afc9c437964e","Type":"ContainerStarted","Data":"10abf157fb3dfcffed212ac07d1be928549bc01e5db990ed80bb5ffa8b9c2eb5"}
Sep 10 19:20:32.762046 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.761884    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"1764a52e2802c6cda108284e23a37c4442345007fe5b59d6f260302e86b5d60d"}
Sep 10 19:20:32.762046 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.761945    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"a0bc5792ef198259deee5a3d933fd2e003101663973575eb75a6606c420074d6"}
Sep 10 19:20:32.762046 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.761978    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"3574d2cfa31a57a27a101ab085546422a3ac682a9fa1b235b0efcaffb33c53e3"}
Sep 10 19:20:32.762046 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.762020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"c3e4e9e1e627771548abde43bfc5523e1027c8ec9617ca6d9be9042251efd3fd"}
Sep 10 19:20:32.762303 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.762056    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"7ab73c97dbbbaaa9006e953b4bfdd20fcc63a4abe6739c84f1e9827789acfa93"}
Sep 10 19:20:32.763505 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.763473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-29wfz" event={"ID":"57ccd984-a453-4cd9-976d-fc0baf29af98","Type":"ContainerStarted","Data":"db52a766f829e6c6c12328950b273cb7b86eff0ce6ab3909bdc6668342ebcb0b"}
Sep 10 19:20:32.765001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.764979    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-brqzm" event={"ID":"937aa937-ea34-4d44-905e-e51593683d06","Type":"ContainerStarted","Data":"8233a20a04cd93fc2af32e28adf15779b236fab4f4c640b109a0c9038371b148"}
Sep 10 19:20:32.772828 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.772788    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-149.ec2.internal" podStartSLOduration=20.772776538 podStartE2EDuration="20.772776538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:16.729919376 +0000 UTC m=+5.546528973" watchObservedRunningTime="2026-09-10 19:20:32.772776538 +0000 UTC m=+21.589386105"
Sep 10 19:20:32.787276 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.787228    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9ctcv" podStartSLOduration=4.321236442 podStartE2EDuration="21.787208288s" totalImagesPullingTime="17.465971846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:32.786897101 +0000 UTC m=+21.603506684" watchObservedRunningTime="2026-09-10 19:20:32.787208288 +0000 UTC m=+21.603817857"
Sep 10 19:20:32.802954 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.802918    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-29wfz" podStartSLOduration=4.323182408 podStartE2EDuration="21.802905998s" totalImagesPullingTime="17.47972359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:32.802302809 +0000 UTC m=+21.618912379" watchObservedRunningTime="2026-09-10 19:20:32.802905998 +0000 UTC m=+21.619515566"
Sep 10 19:20:32.826039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.825874    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-brqzm" podStartSLOduration=4.266938371 podStartE2EDuration="21.825859374s" totalImagesPullingTime="17.558921003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:32.825281788 +0000 UTC m=+21.641891357" watchObservedRunningTime="2026-09-10 19:20:32.825859374 +0000 UTC m=+21.642468982"
Sep 10 19:20:32.846415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.846339    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8xx7n" podStartSLOduration=4.378668244 podStartE2EDuration="21.846318081s" totalImagesPullingTime="17.467649837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:32.845405265 +0000 UTC m=+21.662014858" watchObservedRunningTime="2026-09-10 19:20:32.846318081 +0000 UTC m=+21.662927651"
Sep 10 19:20:32.863707 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:32.863658    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xfvmr" podStartSLOduration=8.442841851 podStartE2EDuration="21.863637429s" totalImagesPullingTime="13.420795578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:32.863281589 +0000 UTC m=+21.679891177" watchObservedRunningTime="2026-09-10 19:20:32.863637429 +0000 UTC m=+21.680246999"
Sep 10 19:20:33.567078 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.567046    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 19:20:33.649965 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.649935    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:33.649965 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.649957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:33.650191 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:33.650059    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:33.650191 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:33.650149    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:33.650301 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.650212    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:33.650301 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:33.650288    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:33.740830 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.740686    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T19:20:33.567069051Z","UUID":"d0f1173f-7b2c-476e-8011-8c22c3957433","Handler":null,"Name":"","Endpoint":""}
Sep 10 19:20:33.742451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.742425    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 19:20:33.742574 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.742458    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 19:20:33.770777 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.770739    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"c71bd6c647b81d96618be40cd6a865693a6155f453e484d0b8d3bf8bc5aecaee"}
Sep 10 19:20:33.772388 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.772339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6gnlj" event={"ID":"022dee1a-e44d-46ca-8ab8-e7521ffbca9e","Type":"ContainerStarted","Data":"e4e2e493a24525c78ae292e4fd62b4986deca7fba71ac99c764a08fa621c914c"}
Sep 10 19:20:33.774310 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.774282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j" event={"ID":"2a070e62-4c11-49e0-ac69-7cff4cc31e40","Type":"ContainerStarted","Data":"9e7e452f63a59cb4332a2fbf76439c80b72b0d7cee9a9046ff2d3f411204042a"}
Sep 10 19:20:33.785558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:33.785519    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6gnlj" podStartSLOduration=5.297452774 podStartE2EDuration="22.785505512s" totalImagesPullingTime="17.488052738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:33.785440115 +0000 UTC m=+22.602049703" watchObservedRunningTime="2026-09-10 19:20:33.785505512 +0000 UTC m=+22.602115097"
Sep 10 19:20:35.649876 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:35.649840    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:35.649876 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:35.649859    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:35.651060 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:35.650340    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:35.651200 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:35.651183    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:35.651267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:35.651249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:35.651432 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:35.651409    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:35.782763 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:35.782724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"a2dacb8d94d27edc00f365e0eda65ec68b908a104b0f55e56d62a2050527afe2"}
Sep 10 19:20:35.785044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:35.785020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j" event={"ID":"2a070e62-4c11-49e0-ac69-7cff4cc31e40","Type":"ContainerStarted","Data":"f41d3016f927d85fb45fb5b5b383c6fe80eafd4745d7041e2afac942245b0b82"}
Sep 10 19:20:35.805449 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:35.805394    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5f4j" podStartSLOduration=5.018689492 podStartE2EDuration="24.805356644s" totalImagesPullingTime="19.786667152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:35.804862846 +0000 UTC m=+24.621472413" watchObservedRunningTime="2026-09-10 19:20:35.805356644 +0000 UTC m=+24.621966213"
Sep 10 19:20:37.604253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.603972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:37.604907 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.604545    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:37.649469 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.649434    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:37.649469 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.649452    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:37.649724 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:37.649542    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:37.649724 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:37.649593    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:37.649724 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.649646    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:37.649724 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:37.649708    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:37.793805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.793769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" event={"ID":"74ae1e88-a0b8-47a5-8b6f-370dda453fc9","Type":"ContainerStarted","Data":"53e8f81e0b699dbf4b4652ebb36e788b2335997617f85a4fa36fb9d897281bea"}
Sep 10 19:20:37.794066 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.793994    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:37.795707 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.795674    2558 generic.go:356] "Generic (PLEG): container finished" podID="0c3158c3-0333-44c0-8738-9a83ad1bb0d1" containerID="b71cb9b2189ba59f74bf7d1d4300d0356688e621abdea1dec9e059c00326dfe6" exitCode=0
Sep 10 19:20:37.795819 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.795757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerDied","Data":"b71cb9b2189ba59f74bf7d1d4300d0356688e621abdea1dec9e059c00326dfe6"}
Sep 10 19:20:37.795922 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.795905    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:37.796448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.796395    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xfvmr"
Sep 10 19:20:37.810038 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.810017    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:37.819229 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:37.819191    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2" podStartSLOduration=9.335399644 podStartE2EDuration="26.819178097s" totalImagesPullingTime="17.483778453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:37.818452098 +0000 UTC m=+26.635061678" watchObservedRunningTime="2026-09-10 19:20:37.819178097 +0000 UTC m=+26.635787665"
Sep 10 19:20:38.798571 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:38.798321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:38.798955 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:38.798820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:38.814074 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:38.814051    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:20:38.996644 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:38.996623    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwds8"]
Sep 10 19:20:38.996785 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:38.996737    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:38.996859 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:38.996818    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:39.000667 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:39.000640    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8btsb"]
Sep 10 19:20:39.000784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:39.000767    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:39.000875 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:39.000848    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:39.001428 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:39.001400    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p2bq2"]
Sep 10 19:20:39.001523 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:39.001500    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:39.001611 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:39.001588    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:39.805024 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:39.804986    2558 generic.go:356] "Generic (PLEG): container finished" podID="0c3158c3-0333-44c0-8738-9a83ad1bb0d1" containerID="cff17fec126ea34dedd393cb9a4474642e72270d4756526057de563340968814" exitCode=0
Sep 10 19:20:39.805455 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:39.805072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerDied","Data":"cff17fec126ea34dedd393cb9a4474642e72270d4756526057de563340968814"}
Sep 10 19:20:40.649548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:40.649471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:40.649681 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:40.649566    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:40.649681 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:40.649577    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:40.649681 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:40.649590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:40.649681 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:40.649649    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:40.649806 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:40.649726    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:41.811973 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:41.811800    2558 generic.go:356] "Generic (PLEG): container finished" podID="0c3158c3-0333-44c0-8738-9a83ad1bb0d1" containerID="8c4d02aa1a83cba514958a5a64bf7d0e03451b703e0d0bbbf858d3cceb3203e5" exitCode=0
Sep 10 19:20:41.812419 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:41.811879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerDied","Data":"8c4d02aa1a83cba514958a5a64bf7d0e03451b703e0d0bbbf858d3cceb3203e5"}
Sep 10 19:20:42.649624 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:42.649581    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:42.649624 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:42.649619    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:42.649855 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:42.649620    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:42.649855 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:42.649709    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:42.649855 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:42.649822    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:42.649978 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:42.649894    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:44.649450 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:44.649424    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:44.650014 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:44.649431    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:44.650014 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:44.649547    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8btsb" podUID="303175c3-e49f-4cdc-bf40-73d0a90e2341"
Sep 10 19:20:44.650014 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:44.649429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:44.650014 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:44.649642    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2bq2" podUID="30dda39a-f601-4b21-a352-6875d28350f8"
Sep 10 19:20:44.650014 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:44.649728    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwds8" podUID="d73d1992-e3e8-46c7-9a80-ee3a2fb672ea"
Sep 10 19:20:45.013813 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.013731    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-149.ec2.internal" event="NodeReady"
Sep 10 19:20:45.013971 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.013899    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 19:20:45.061608 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.061576    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5547b54c79-nlwdh"]
Sep 10 19:20:45.064536 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.064516    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.068408 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.068368    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 19:20:45.068550 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.068453    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x5vxr\""
Sep 10 19:20:45.068550 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.068473    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 19:20:45.069151 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.069112    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 19:20:45.073924 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.073883    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 19:20:45.076483 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.076463    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wzfcj"]
Sep 10 19:20:45.078336 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.078318    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.080039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.080017    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-65jm6"]
Sep 10 19:20:45.082038 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.082017    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5547b54c79-nlwdh"]
Sep 10 19:20:45.082132 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.082098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.083066 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.083038    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 19:20:45.083151 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.083112    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2kts8\""
Sep 10 19:20:45.083229 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.083044    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 19:20:45.084443 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.084426    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gl8x4\""
Sep 10 19:20:45.084592 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.084567    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 19:20:45.084685 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.084613    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 19:20:45.084685 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.084522    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 19:20:45.096060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.095944    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wzfcj"]
Sep 10 19:20:45.097299 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.097280    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-65jm6"]
Sep 10 19:20:45.205725 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-image-registry-private-configuration\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.205725 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205731    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-bound-sa-token\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.205976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-registry-certificates\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.205976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-trusted-ca\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.205976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82334143-4b6f-45c1-b80d-ca73b4c5b33a-config-volume\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.205976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kj2r\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-kube-api-access-6kj2r\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.205976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-installation-pull-secrets\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.206240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.205989    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.206240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.206035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82334143-4b6f-45c1-b80d-ca73b4c5b33a-tmp-dir\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.206240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.206086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcv8\" (UniqueName: \"kubernetes.io/projected/82334143-4b6f-45c1-b80d-ca73b4c5b33a-kube-api-access-pwcv8\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.206240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.206116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72cdca30-8f4c-417a-80b8-0dc950d6d3c2-cert\") pod \"ingress-canary-65jm6\" (UID: \"72cdca30-8f4c-417a-80b8-0dc950d6d3c2\") " pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.206240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.206147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8dc0-a090-4960-88b6-539924a604c3-ca-trust-extracted\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.206240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.206189    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rd2h\" (UniqueName: \"kubernetes.io/projected/72cdca30-8f4c-417a-80b8-0dc950d6d3c2-kube-api-access-5rd2h\") pod \"ingress-canary-65jm6\" (UID: \"72cdca30-8f4c-417a-80b8-0dc950d6d3c2\") " pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.206544 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.206241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.306864 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.306790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rd2h\" (UniqueName: \"kubernetes.io/projected/72cdca30-8f4c-417a-80b8-0dc950d6d3c2-kube-api-access-5rd2h\") pod \"ingress-canary-65jm6\" (UID: \"72cdca30-8f4c-417a-80b8-0dc950d6d3c2\") " pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.306864 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.306842    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:45.307056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.306907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307056 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.306936    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:45.307056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.306947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-image-registry-private-configuration\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.306970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-bound-sa-token\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307056 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.307006    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret podName:d73d1992-e3e8-46c7-9a80-ee3a2fb672ea nodeName:}" failed. No retries permitted until 2026-09-10 19:21:17.306987417 +0000 UTC m=+66.123596964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret") pod "global-pull-secret-syncer-kwds8" (UID: "d73d1992-e3e8-46c7-9a80-ee3a2fb672ea") : object "kube-system"/"original-pull-secret" not registered
Sep 10 19:20:45.307056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-registry-certificates\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-trusted-ca\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.307143    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.307163    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5547b54c79-nlwdh: secret "image-registry-tls" not found
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.307211    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls podName:afcc8dc0-a090-4960-88b6-539924a604c3 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:45.807194039 +0000 UTC m=+34.623803588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls") pod "image-registry-5547b54c79-nlwdh" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3") : secret "image-registry-tls" not found
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82334143-4b6f-45c1-b80d-ca73b4c5b33a-config-volume\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kj2r\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-kube-api-access-6kj2r\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-installation-pull-secrets\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.307342 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.307343    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:45.307839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82334143-4b6f-45c1-b80d-ca73b4c5b33a-tmp-dir\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.307839 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.307407    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs podName:30dda39a-f601-4b21-a352-6875d28350f8 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:17.307392352 +0000 UTC m=+66.124001900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs") pod "network-metrics-daemon-p2bq2" (UID: "30dda39a-f601-4b21-a352-6875d28350f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 19:20:45.307839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcv8\" (UniqueName: \"kubernetes.io/projected/82334143-4b6f-45c1-b80d-ca73b4c5b33a-kube-api-access-pwcv8\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.307839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72cdca30-8f4c-417a-80b8-0dc950d6d3c2-cert\") pod \"ingress-canary-65jm6\" (UID: \"72cdca30-8f4c-417a-80b8-0dc950d6d3c2\") " pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.307839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8dc0-a090-4960-88b6-539924a604c3-ca-trust-extracted\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.307839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82334143-4b6f-45c1-b80d-ca73b4c5b33a-tmp-dir\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.308123 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307838    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8dc0-a090-4960-88b6-539924a604c3-ca-trust-extracted\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.308123 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.307852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-registry-certificates\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.308123 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.307923    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:20:45.313355 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.308861    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls podName:82334143-4b6f-45c1-b80d-ca73b4c5b33a nodeName:}" failed. No retries permitted until 2026-09-10 19:20:45.807964399 +0000 UTC m=+34.624573962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls") pod "dns-default-wzfcj" (UID: "82334143-4b6f-45c1-b80d-ca73b4c5b33a") : secret "dns-default-metrics-tls" not found
Sep 10 19:20:45.313355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.309224    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82334143-4b6f-45c1-b80d-ca73b4c5b33a-config-volume\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.313355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.309280    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-trusted-ca\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.313355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.312588    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-image-registry-private-configuration\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.313355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.312591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72cdca30-8f4c-417a-80b8-0dc950d6d3c2-cert\") pod \"ingress-canary-65jm6\" (UID: \"72cdca30-8f4c-417a-80b8-0dc950d6d3c2\") " pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.314779 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.314750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-installation-pull-secrets\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.316186 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.316143    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rd2h\" (UniqueName: \"kubernetes.io/projected/72cdca30-8f4c-417a-80b8-0dc950d6d3c2-kube-api-access-5rd2h\") pod \"ingress-canary-65jm6\" (UID: \"72cdca30-8f4c-417a-80b8-0dc950d6d3c2\") " pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.316285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.316184    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-bound-sa-token\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.316285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.316240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kj2r\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-kube-api-access-6kj2r\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.317292 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.317254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcv8\" (UniqueName: \"kubernetes.io/projected/82334143-4b6f-45c1-b80d-ca73b4c5b33a-kube-api-access-pwcv8\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.395576 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.395546    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-65jm6"
Sep 10 19:20:45.509177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.509136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:45.509339 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.509286    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 19:20:45.509339 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.509315    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 19:20:45.509339 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.509328    2558 projected.go:196] Error preparing data for projected volume kube-api-access-rpx5l for pod openshift-network-diagnostics/network-check-target-8btsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:45.509491 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.509420    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l podName:303175c3-e49f-4cdc-bf40-73d0a90e2341 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:17.509400055 +0000 UTC m=+66.326009606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rpx5l" (UniqueName: "kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l") pod "network-check-target-8btsb" (UID: "303175c3-e49f-4cdc-bf40-73d0a90e2341") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 19:20:45.811548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.811511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:45.812232 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:45.811613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:45.812232 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.811690    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 19:20:45.812232 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.811709    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5547b54c79-nlwdh: secret "image-registry-tls" not found
Sep 10 19:20:45.812232 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.811727    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:20:45.812232 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.811786    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls podName:afcc8dc0-a090-4960-88b6-539924a604c3 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:46.811764245 +0000 UTC m=+35.628373798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls") pod "image-registry-5547b54c79-nlwdh" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3") : secret "image-registry-tls" not found
Sep 10 19:20:45.812232 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:45.811807    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls podName:82334143-4b6f-45c1-b80d-ca73b4c5b33a nodeName:}" failed. No retries permitted until 2026-09-10 19:20:46.811797493 +0000 UTC m=+35.628407043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls") pod "dns-default-wzfcj" (UID: "82334143-4b6f-45c1-b80d-ca73b4c5b33a") : secret "dns-default-metrics-tls" not found
Sep 10 19:20:46.467866 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.467636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-65jm6"]
Sep 10 19:20:46.474257 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:20:46.474232    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cdca30_8f4c_417a_80b8_0dc950d6d3c2.slice/crio-7d55c3d8a957690d020c59f105464b8e6d74b2c12e80c0370954368908582395 WatchSource:0}: Error finding container 7d55c3d8a957690d020c59f105464b8e6d74b2c12e80c0370954368908582395: Status 404 returned error can't find the container with id 7d55c3d8a957690d020c59f105464b8e6d74b2c12e80c0370954368908582395
Sep 10 19:20:46.649437 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.649396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:20:46.649437 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.649417    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:20:46.649634 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.649505    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:20:46.652120 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.652098    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 19:20:46.652701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.652681    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 19:20:46.652770 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.652702    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npjmj\""
Sep 10 19:20:46.652770 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.652725    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 19:20:46.652868 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.652853    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 19:20:46.652909 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.652857    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-plphg\""
Sep 10 19:20:46.819691 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.819593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:46.819691 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.819663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:46.820187 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:46.819762    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:20:46.820187 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:46.819835    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 19:20:46.820187 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:46.819848    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5547b54c79-nlwdh: secret "image-registry-tls" not found
Sep 10 19:20:46.820187 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:46.819848    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls podName:82334143-4b6f-45c1-b80d-ca73b4c5b33a nodeName:}" failed. No retries permitted until 2026-09-10 19:20:48.819823002 +0000 UTC m=+37.636432564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls") pod "dns-default-wzfcj" (UID: "82334143-4b6f-45c1-b80d-ca73b4c5b33a") : secret "dns-default-metrics-tls" not found
Sep 10 19:20:46.820187 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:46.819900    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls podName:afcc8dc0-a090-4960-88b6-539924a604c3 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:48.819884696 +0000 UTC m=+37.636494257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls") pod "image-registry-5547b54c79-nlwdh" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3") : secret "image-registry-tls" not found
Sep 10 19:20:46.827429 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.827399    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-65jm6" event={"ID":"72cdca30-8f4c-417a-80b8-0dc950d6d3c2","Type":"ContainerStarted","Data":"7d55c3d8a957690d020c59f105464b8e6d74b2c12e80c0370954368908582395"}
Sep 10 19:20:46.830297 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.830275    2558 generic.go:356] "Generic (PLEG): container finished" podID="0c3158c3-0333-44c0-8738-9a83ad1bb0d1" containerID="8e997838f7368c9603ef7996ae6e2a8be0fac2e1b58fc3eda9ce773f6d7dfdd9" exitCode=0
Sep 10 19:20:46.830419 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:46.830309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerDied","Data":"8e997838f7368c9603ef7996ae6e2a8be0fac2e1b58fc3eda9ce773f6d7dfdd9"}
Sep 10 19:20:47.837029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:47.836986    2558 generic.go:356] "Generic (PLEG): container finished" podID="0c3158c3-0333-44c0-8738-9a83ad1bb0d1" containerID="e4b2fbf2dda677519359dd18c798d03e4a045226563b525f49dc28920de01f3e" exitCode=0
Sep 10 19:20:47.837551 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:47.837066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerDied","Data":"e4b2fbf2dda677519359dd18c798d03e4a045226563b525f49dc28920de01f3e"}
Sep 10 19:20:48.837759 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:48.837545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:48.837759 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:48.837709    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:20:48.837759 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:48.837753    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:48.838281 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:48.837780    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls podName:82334143-4b6f-45c1-b80d-ca73b4c5b33a nodeName:}" failed. No retries permitted until 2026-09-10 19:20:52.837759061 +0000 UTC m=+41.654368621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls") pod "dns-default-wzfcj" (UID: "82334143-4b6f-45c1-b80d-ca73b4c5b33a") : secret "dns-default-metrics-tls" not found
Sep 10 19:20:48.838281 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:48.837826    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 19:20:48.838281 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:48.837838    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5547b54c79-nlwdh: secret "image-registry-tls" not found
Sep 10 19:20:48.838281 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:48.837881    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls podName:afcc8dc0-a090-4960-88b6-539924a604c3 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:52.837869295 +0000 UTC m=+41.654478846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls") pod "image-registry-5547b54c79-nlwdh" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3") : secret "image-registry-tls" not found
Sep 10 19:20:48.842625 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:48.842598    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" event={"ID":"0c3158c3-0333-44c0-8738-9a83ad1bb0d1","Type":"ContainerStarted","Data":"9b46e123042821ee015cf79c76d230461103c720199c90f34a38b2d176eb0472"}
Sep 10 19:20:48.867671 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:48.867626    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9dtz9" podStartSLOduration=9.625440978 podStartE2EDuration="37.867610275s" totalImagesPullingTime="28.242169297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:48.866251811 +0000 UTC m=+37.682861378" watchObservedRunningTime="2026-09-10 19:20:48.867610275 +0000 UTC m=+37.684219842"
Sep 10 19:20:49.846880 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:49.846846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-65jm6" event={"ID":"72cdca30-8f4c-417a-80b8-0dc950d6d3c2","Type":"ContainerStarted","Data":"6087f92ffb73c2c09c4e1444ef079435eb833b51cfc41f35ead7c06528cf58fc"}
Sep 10 19:20:49.880652 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:49.880606    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-65jm6" podStartSLOduration=2.498322155 podStartE2EDuration="4.880590783s" totalImagesPullingTime="2.382268628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:20:49.880202218 +0000 UTC m=+38.696811808" watchObservedRunningTime="2026-09-10 19:20:49.880590783 +0000 UTC m=+38.697200373"
Sep 10 19:20:52.866655 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:52.866618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:20:52.867112 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:52.866679    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:20:52.867112 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:52.866764    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 19:20:52.867112 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:52.866787    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5547b54c79-nlwdh: secret "image-registry-tls" not found
Sep 10 19:20:52.867112 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:52.866768    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:20:52.867112 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:52.866834    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls podName:afcc8dc0-a090-4960-88b6-539924a604c3 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:00.866820067 +0000 UTC m=+49.683429618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls") pod "image-registry-5547b54c79-nlwdh" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3") : secret "image-registry-tls" not found
Sep 10 19:20:52.867112 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:52.866847    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls podName:82334143-4b6f-45c1-b80d-ca73b4c5b33a nodeName:}" failed. No retries permitted until 2026-09-10 19:21:00.866840872 +0000 UTC m=+49.683450418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls") pod "dns-default-wzfcj" (UID: "82334143-4b6f-45c1-b80d-ca73b4c5b33a") : secret "dns-default-metrics-tls" not found
Sep 10 19:20:53.583678 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.583646    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wcwp8"]
Sep 10 19:20:53.610160 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.610131    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wcwp8"]
Sep 10 19:20:53.610316 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.610256    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.612272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.612248    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 19:20:53.612475 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.612453    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 19:20:53.612571 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.612495    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7hkk9\""
Sep 10 19:20:53.612571 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.612511    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 19:20:53.613002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.612988    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 19:20:53.772645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.772608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxplq\" (UniqueName: \"kubernetes.io/projected/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-api-access-dxplq\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.772645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.772645    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/472a8d76-7aa4-4028-a3bd-e343b9c0c633-crio-socket\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.772889 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.772664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.772889 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.772784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.772889 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.772833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/472a8d76-7aa4-4028-a3bd-e343b9c0c633-data-volume\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.874050 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.873974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxplq\" (UniqueName: \"kubernetes.io/projected/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-api-access-dxplq\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.874050 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.874006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/472a8d76-7aa4-4028-a3bd-e343b9c0c633-crio-socket\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.874050 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.874023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.874075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.874099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/472a8d76-7aa4-4028-a3bd-e343b9c0c633-data-volume\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:53.874167    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:53.874215    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:53.874229    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:54.374214424 +0000 UTC m=+43.190823975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : configmap "kube-rbac-proxy" not found
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.874239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/472a8d76-7aa4-4028-a3bd-e343b9c0c633-crio-socket\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:53.874269    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:54.374251516 +0000 UTC m=+43.190861076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:20:53.874556 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.874440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/472a8d76-7aa4-4028-a3bd-e343b9c0c633-data-volume\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:53.884074 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:53.884052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxplq\" (UniqueName: \"kubernetes.io/projected/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-api-access-dxplq\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:54.379388 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:54.379337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:54.379574 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:54.379413    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:54.379574 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:54.379479    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:20:54.379574 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:54.379530    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:20:54.379574 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:54.379560    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:55.379544239 +0000 UTC m=+44.196153784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : configmap "kube-rbac-proxy" not found
Sep 10 19:20:54.379574 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:54.379577    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:55.379566426 +0000 UTC m=+44.196175973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:20:55.388598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:55.388559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:55.389098 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:55.388638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:55.389098 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:55.388705    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:20:55.389098 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:55.388790    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:20:55.389098 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:55.388801    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:57.388779848 +0000 UTC m=+46.205389417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : configmap "kube-rbac-proxy" not found
Sep 10 19:20:55.389098 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:55.388851    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:20:57.388822332 +0000 UTC m=+46.205431892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:20:55.549835 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:55.549805    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9ctcv_b0bfcc8d-58a9-408d-ad9c-afc9c437964e/dns-node-resolver/0.log"
Sep 10 19:20:56.349673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:56.349643    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-29wfz_57ccd984-a453-4cd9-976d-fc0baf29af98/node-ca/0.log"
Sep 10 19:20:57.150298 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:57.150265    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-65jm6_72cdca30-8f4c-417a-80b8-0dc950d6d3c2/serve-healthcheck-canary/0.log"
Sep 10 19:20:57.404982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:57.404891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:57.404982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:20:57.404972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:20:57.405159 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:57.405036    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 19:20:57.405159 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:57.405091    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:20:57.405159 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:57.405112    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:01.405090794 +0000 UTC m=+50.221700361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : configmap "kube-rbac-proxy" not found
Sep 10 19:20:57.405159 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:20:57.405129    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:01.40511856 +0000 UTC m=+50.221728107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:21:00.932947 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:00.932903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:00.933403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:00.933008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:21:00.933403 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:00.933056    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 19:21:00.933403 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:00.933075    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5547b54c79-nlwdh: secret "image-registry-tls" not found
Sep 10 19:21:00.933403 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:00.933133    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls podName:afcc8dc0-a090-4960-88b6-539924a604c3 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:16.933115476 +0000 UTC m=+65.749725022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls") pod "image-registry-5547b54c79-nlwdh" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3") : secret "image-registry-tls" not found
Sep 10 19:21:00.933403 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:00.933145    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 19:21:00.933403 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:00.933196    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls podName:82334143-4b6f-45c1-b80d-ca73b4c5b33a nodeName:}" failed. No retries permitted until 2026-09-10 19:21:16.933181016 +0000 UTC m=+65.749790566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls") pod "dns-default-wzfcj" (UID: "82334143-4b6f-45c1-b80d-ca73b4c5b33a") : secret "dns-default-metrics-tls" not found
Sep 10 19:21:01.437353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:01.437319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:21:01.437622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:01.437426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:21:01.437622 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:01.437495    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 19:21:01.437622 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:01.437563    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls podName:472a8d76-7aa4-4028-a3bd-e343b9c0c633 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:09.437546027 +0000 UTC m=+58.254155577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wcwp8" (UID: "472a8d76-7aa4-4028-a3bd-e343b9c0c633") : secret "insights-runtime-extractor-tls" not found
Sep 10 19:21:01.437907 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:01.437890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/472a8d76-7aa4-4028-a3bd-e343b9c0c633-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:21:09.497144 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:09.497100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:21:09.499412 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:09.499392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/472a8d76-7aa4-4028-a3bd-e343b9c0c633-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcwp8\" (UID: \"472a8d76-7aa4-4028-a3bd-e343b9c0c633\") " pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:21:09.519309 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:09.519277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wcwp8"
Sep 10 19:21:09.834413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:09.834312    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wcwp8"]
Sep 10 19:21:09.837945 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:09.837920    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472a8d76_7aa4_4028_a3bd_e343b9c0c633.slice/crio-6f41d0b4453e4762756918953abcccdc779a9d92080ab26d5302a03cf7ed8fb9 WatchSource:0}: Error finding container 6f41d0b4453e4762756918953abcccdc779a9d92080ab26d5302a03cf7ed8fb9: Status 404 returned error can't find the container with id 6f41d0b4453e4762756918953abcccdc779a9d92080ab26d5302a03cf7ed8fb9
Sep 10 19:21:09.895290 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:09.895261    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcwp8" event={"ID":"472a8d76-7aa4-4028-a3bd-e343b9c0c633","Type":"ContainerStarted","Data":"6f41d0b4453e4762756918953abcccdc779a9d92080ab26d5302a03cf7ed8fb9"}
Sep 10 19:21:10.818393 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:10.818347    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q28s2"
Sep 10 19:21:10.900484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:10.900413    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcwp8" event={"ID":"472a8d76-7aa4-4028-a3bd-e343b9c0c633","Type":"ContainerStarted","Data":"98e77e72c9a54156c9c4b87759a76659490a5d4de9e1077a7b5dfe289073e7b3"}
Sep 10 19:21:11.905008 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:11.904966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcwp8" event={"ID":"472a8d76-7aa4-4028-a3bd-e343b9c0c633","Type":"ContainerStarted","Data":"383020a846078e618b6ec833cbe363c8991393339699063f90f01032c7eb08a0"}
Sep 10 19:21:12.909428 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:12.909388    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcwp8" event={"ID":"472a8d76-7aa4-4028-a3bd-e343b9c0c633","Type":"ContainerStarted","Data":"8c5e534073b68c3df8576d37d339384631d0536aa2cc6fd18f1894050cf445b3"}
Sep 10 19:21:12.930083 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:12.930030    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wcwp8" podStartSLOduration=17.211291977 podStartE2EDuration="19.930013075s" totalImagesPullingTime="2.718721098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:12.928448973 +0000 UTC m=+61.745058552" watchObservedRunningTime="2026-09-10 19:21:12.930013075 +0000 UTC m=+61.746622643"
Sep 10 19:21:16.961585 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:16.961550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:21:16.962019 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:16.961609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:16.963891 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:16.963865    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"image-registry-5547b54c79-nlwdh\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") " pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:16.963891 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:16.963874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82334143-4b6f-45c1-b80d-ca73b4c5b33a-metrics-tls\") pod \"dns-default-wzfcj\" (UID: \"82334143-4b6f-45c1-b80d-ca73b4c5b33a\") " pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:21:17.176985 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.176952    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x5vxr\""
Sep 10 19:21:17.185621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.185601    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:17.191765 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.191746    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2kts8\""
Sep 10 19:21:17.200893 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.200873    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:21:17.363923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.363885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:21:17.363923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.363930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:21:17.366382 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.366354    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 19:21:17.366459 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.366354    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 19:21:17.376428 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.376401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73d1992-e3e8-46c7-9a80-ee3a2fb672ea-original-pull-secret\") pod \"global-pull-secret-syncer-kwds8\" (UID: \"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea\") " pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:21:17.376488 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.376447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30dda39a-f601-4b21-a352-6875d28350f8-metrics-certs\") pod \"network-metrics-daemon-p2bq2\" (UID: \"30dda39a-f601-4b21-a352-6875d28350f8\") " pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:21:17.477583 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.477498    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5547b54c79-nlwdh"]
Sep 10 19:21:17.480603 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:17.480578    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafcc8dc0_a090_4960_88b6_539924a604c3.slice/crio-b0fa17d9e515eade4346bf7782a3679a58f4d47aab10ebd1dde648ae0eb89b13 WatchSource:0}: Error finding container b0fa17d9e515eade4346bf7782a3679a58f4d47aab10ebd1dde648ae0eb89b13: Status 404 returned error can't find the container with id b0fa17d9e515eade4346bf7782a3679a58f4d47aab10ebd1dde648ae0eb89b13
Sep 10 19:21:17.494985 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.494961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wzfcj"]
Sep 10 19:21:17.497541 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:17.497514    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82334143_4b6f_45c1_b80d_ca73b4c5b33a.slice/crio-d5f7894d4cfcffe2764ad7c9daf42bb35ceadde52f153211968cdf19d0f0fef5 WatchSource:0}: Error finding container d5f7894d4cfcffe2764ad7c9daf42bb35ceadde52f153211968cdf19d0f0fef5: Status 404 returned error can't find the container with id d5f7894d4cfcffe2764ad7c9daf42bb35ceadde52f153211968cdf19d0f0fef5
Sep 10 19:21:17.561195 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.561175    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npjmj\""
Sep 10 19:21:17.564943 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.564927    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwds8"
Sep 10 19:21:17.565061 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.565045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:21:17.567225 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.567206    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 19:21:17.568900 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.568882    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2bq2"
Sep 10 19:21:17.578036 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.578018    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 19:21:17.588468 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.588445    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpx5l\" (UniqueName: \"kubernetes.io/projected/303175c3-e49f-4cdc-bf40-73d0a90e2341-kube-api-access-rpx5l\") pod \"network-check-target-8btsb\" (UID: \"303175c3-e49f-4cdc-bf40-73d0a90e2341\") " pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:21:17.851426 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.851338    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwds8"]
Sep 10 19:21:17.854511 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:17.854485    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73d1992_e3e8_46c7_9a80_ee3a2fb672ea.slice/crio-1aec780936717d01311f79de131d49578318f5510f1002dd54e59854d71cb211 WatchSource:0}: Error finding container 1aec780936717d01311f79de131d49578318f5510f1002dd54e59854d71cb211: Status 404 returned error can't find the container with id 1aec780936717d01311f79de131d49578318f5510f1002dd54e59854d71cb211
Sep 10 19:21:17.870861 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.870839    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-plphg\""
Sep 10 19:21:17.879722 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.879703    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:21:17.882351 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.882326    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p2bq2"]
Sep 10 19:21:17.888038 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:17.888017    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30dda39a_f601_4b21_a352_6875d28350f8.slice/crio-dd65a3bdead9d2309e4918ff187d80110e9c6a3bc7bd5a8bbfff92aeea2321f5 WatchSource:0}: Error finding container dd65a3bdead9d2309e4918ff187d80110e9c6a3bc7bd5a8bbfff92aeea2321f5: Status 404 returned error can't find the container with id dd65a3bdead9d2309e4918ff187d80110e9c6a3bc7bd5a8bbfff92aeea2321f5
Sep 10 19:21:17.925043 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.924955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwds8" event={"ID":"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea","Type":"ContainerStarted","Data":"1aec780936717d01311f79de131d49578318f5510f1002dd54e59854d71cb211"}
Sep 10 19:21:17.926446 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.926411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzfcj" event={"ID":"82334143-4b6f-45c1-b80d-ca73b4c5b33a","Type":"ContainerStarted","Data":"d5f7894d4cfcffe2764ad7c9daf42bb35ceadde52f153211968cdf19d0f0fef5"}
Sep 10 19:21:17.927712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.927685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2bq2" event={"ID":"30dda39a-f601-4b21-a352-6875d28350f8","Type":"ContainerStarted","Data":"dd65a3bdead9d2309e4918ff187d80110e9c6a3bc7bd5a8bbfff92aeea2321f5"}
Sep 10 19:21:17.929385 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.929347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh" event={"ID":"afcc8dc0-a090-4960-88b6-539924a604c3","Type":"ContainerStarted","Data":"5014684a618bf1ad8de4d6fb7ba6002a6a5ee319eeb3dc8c4a10f9ac3e21eefc"}
Sep 10 19:21:17.929465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.929407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh" event={"ID":"afcc8dc0-a090-4960-88b6-539924a604c3","Type":"ContainerStarted","Data":"b0fa17d9e515eade4346bf7782a3679a58f4d47aab10ebd1dde648ae0eb89b13"}
Sep 10 19:21:17.929768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.929745    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:17.948750 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:17.948697    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh" podStartSLOduration=68.948677233 podStartE2EDuration="1m8.948677233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:17.948463779 +0000 UTC m=+66.765073366" watchObservedRunningTime="2026-09-10 19:21:17.948677233 +0000 UTC m=+66.765286802"
Sep 10 19:21:18.167784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:18.167693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8btsb"]
Sep 10 19:21:18.171991 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:18.171958    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303175c3_e49f_4cdc_bf40_73d0a90e2341.slice/crio-d4bc5e2ff308e123dc189473e07539e110c883f35cd4393c1e7e0a2e66812ed0 WatchSource:0}: Error finding container d4bc5e2ff308e123dc189473e07539e110c883f35cd4393c1e7e0a2e66812ed0: Status 404 returned error can't find the container with id d4bc5e2ff308e123dc189473e07539e110c883f35cd4393c1e7e0a2e66812ed0
Sep 10 19:21:18.935162 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:18.935075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8btsb" event={"ID":"303175c3-e49f-4cdc-bf40-73d0a90e2341","Type":"ContainerStarted","Data":"d4bc5e2ff308e123dc189473e07539e110c883f35cd4393c1e7e0a2e66812ed0"}
Sep 10 19:21:19.942083 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:19.942044    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzfcj" event={"ID":"82334143-4b6f-45c1-b80d-ca73b4c5b33a","Type":"ContainerStarted","Data":"b8842912453cbf8a32b2ec17ff06e8bb117fecbb2cee184a163ac5d49e378918"}
Sep 10 19:21:19.942539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:19.942138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzfcj" event={"ID":"82334143-4b6f-45c1-b80d-ca73b4c5b33a","Type":"ContainerStarted","Data":"55be3219c17a178c9ea0c8c5da167abb5295555a857996f5a5ab53523828833b"}
Sep 10 19:21:19.942539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:19.942484    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:21:19.945114 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:19.945083    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2bq2" event={"ID":"30dda39a-f601-4b21-a352-6875d28350f8","Type":"ContainerStarted","Data":"b653b4049fb9f1c65cfa5e1851575d2935a8290b660aa11fef3cd7d9b8970617"}
Sep 10 19:21:19.945231 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:19.945136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2bq2" event={"ID":"30dda39a-f601-4b21-a352-6875d28350f8","Type":"ContainerStarted","Data":"7595a56b27b26964c7713d7f9ec975204bc2f114dcc6fc7718a2209a6db08c3e"}
Sep 10 19:21:19.962957 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:19.962519    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wzfcj" podStartSLOduration=32.79923504 podStartE2EDuration="34.962500363s" totalImagesPullingTime="2.163265323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:19.961060725 +0000 UTC m=+68.777670321" watchObservedRunningTime="2026-09-10 19:21:19.962500363 +0000 UTC m=+68.779109933"
Sep 10 19:21:19.980572 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:19.980126    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p2bq2" podStartSLOduration=67.212562528 podStartE2EDuration="1m8.980103922s" totalImagesPullingTime="1.767541394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:19.979482769 +0000 UTC m=+68.796092364" watchObservedRunningTime="2026-09-10 19:21:19.980103922 +0000 UTC m=+68.796713492"
Sep 10 19:21:20.769096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.769057    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"]
Sep 10 19:21:20.772087 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.772059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:20.779456 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.779431    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 19:21:20.779933 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.779912    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"]
Sep 10 19:21:20.781663 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.781648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:20.782602 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.782588    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 19:21:20.783894 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.783880    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 19:21:20.788464 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.788444    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"]
Sep 10 19:21:20.789098 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.789082    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-b6txc\""
Sep 10 19:21:20.789465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.789450    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 19:21:20.789526 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.789511    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 19:21:20.811550 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.811521    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5547b54c79-nlwdh"]
Sep 10 19:21:20.815747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.815721    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"]
Sep 10 19:21:20.857631 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.857517    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"]
Sep 10 19:21:20.859580 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.859552    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-mcf7h"]
Sep 10 19:21:20.859805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.859786    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"
Sep 10 19:21:20.861897 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.861876    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-mcf7h"
Sep 10 19:21:20.866578 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.866553    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 19:21:20.866792 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.866761    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 19:21:20.866792 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.866771    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bckk5\""
Sep 10 19:21:20.866885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.866791    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xttgv\""
Sep 10 19:21:20.867088 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.867066    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 19:21:20.892143 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.891855    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx4kf\" (UniqueName: \"kubernetes.io/projected/b631764d-5879-43d0-82dd-cd49128a142e-kube-api-access-bx4kf\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:20.892143 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.891901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b631764d-5879-43d0-82dd-cd49128a142e-tmp\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:20.892143 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.891930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhgbb\" (UniqueName: \"kubernetes.io/projected/0365ce21-4d85-45d9-8cb2-549f1f45bf2d-kube-api-access-fhgbb\") pod \"managed-serviceaccount-addon-agent-76559c4496-ttl8s\" (UID: \"0365ce21-4d85-45d9-8cb2-549f1f45bf2d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:20.892143 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.891969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b631764d-5879-43d0-82dd-cd49128a142e-klusterlet-config\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:20.892143 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.891999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0365ce21-4d85-45d9-8cb2-549f1f45bf2d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76559c4496-ttl8s\" (UID: \"0365ce21-4d85-45d9-8cb2-549f1f45bf2d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:20.914431 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.914401    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"]
Sep 10 19:21:20.915615 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.915590    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-mcf7h"]
Sep 10 19:21:20.980160 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.980128    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-595d9c976d-jht75"]
Sep 10 19:21:20.983057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.983031    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:20.993263 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b631764d-5879-43d0-82dd-cd49128a142e-tmp\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:20.993367 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993284    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhgbb\" (UniqueName: \"kubernetes.io/projected/0365ce21-4d85-45d9-8cb2-549f1f45bf2d-kube-api-access-fhgbb\") pod \"managed-serviceaccount-addon-agent-76559c4496-ttl8s\" (UID: \"0365ce21-4d85-45d9-8cb2-549f1f45bf2d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:20.993367 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b631764d-5879-43d0-82dd-cd49128a142e-klusterlet-config\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:20.993501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0365ce21-4d85-45d9-8cb2-549f1f45bf2d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76559c4496-ttl8s\" (UID: \"0365ce21-4d85-45d9-8cb2-549f1f45bf2d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:20.993501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c8ps\" (UniqueName: \"kubernetes.io/projected/b30c88a5-d90d-4b16-98a9-c673fabda0d6-kube-api-access-9c8ps\") pod \"downloads-85d98c998f-mcf7h\" (UID: \"b30c88a5-d90d-4b16-98a9-c673fabda0d6\") " pod="openshift-console/downloads-85d98c998f-mcf7h"
Sep 10 19:21:20.993595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx4kf\" (UniqueName: \"kubernetes.io/projected/b631764d-5879-43d0-82dd-cd49128a142e-kube-api-access-bx4kf\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:20.993595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2bc595cd-c8e6-47d3-9735-3d83421b3ad8-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-5qdzh\" (UID: \"2bc595cd-c8e6-47d3-9735-3d83421b3ad8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"
Sep 10 19:21:20.993725 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:20.993706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b631764d-5879-43d0-82dd-cd49128a142e-tmp\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:21.001041 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.001012    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0365ce21-4d85-45d9-8cb2-549f1f45bf2d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76559c4496-ttl8s\" (UID: \"0365ce21-4d85-45d9-8cb2-549f1f45bf2d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:21.002225 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.002200    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b631764d-5879-43d0-82dd-cd49128a142e-klusterlet-config\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:21.032536 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.032467    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595d9c976d-jht75"]
Sep 10 19:21:21.035851 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.035822    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhgbb\" (UniqueName: \"kubernetes.io/projected/0365ce21-4d85-45d9-8cb2-549f1f45bf2d-kube-api-access-fhgbb\") pod \"managed-serviceaccount-addon-agent-76559c4496-ttl8s\" (UID: \"0365ce21-4d85-45d9-8cb2-549f1f45bf2d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:21.036267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.036246    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx4kf\" (UniqueName: \"kubernetes.io/projected/b631764d-5879-43d0-82dd-cd49128a142e-kube-api-access-bx4kf\") pod \"klusterlet-addon-workmgr-59dc6d444-lwgtt\" (UID: \"b631764d-5879-43d0-82dd-cd49128a142e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:21.091954 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.091917    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"
Sep 10 19:21:21.094232 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58085a60-fe26-40c7-9901-100acd34c1d6-registry-certificates\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.094359 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c8ps\" (UniqueName: \"kubernetes.io/projected/b30c88a5-d90d-4b16-98a9-c673fabda0d6-kube-api-access-9c8ps\") pod \"downloads-85d98c998f-mcf7h\" (UID: \"b30c88a5-d90d-4b16-98a9-c673fabda0d6\") " pod="openshift-console/downloads-85d98c998f-mcf7h"
Sep 10 19:21:21.094474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094451    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2bc595cd-c8e6-47d3-9735-3d83421b3ad8-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-5qdzh\" (UID: \"2bc595cd-c8e6-47d3-9735-3d83421b3ad8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"
Sep 10 19:21:21.094549 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094497    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-bound-sa-token\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.094549 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58085a60-fe26-40c7-9901-100acd34c1d6-installation-pull-secrets\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.094658 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrrg\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-kube-api-access-7lrrg\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.094658 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-registry-tls\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.095139 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58085a60-fe26-40c7-9901-100acd34c1d6-image-registry-private-configuration\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.095139 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58085a60-fe26-40c7-9901-100acd34c1d6-ca-trust-extracted\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.095139 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.094815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58085a60-fe26-40c7-9901-100acd34c1d6-trusted-ca\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.097768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.097733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2bc595cd-c8e6-47d3-9735-3d83421b3ad8-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-5qdzh\" (UID: \"2bc595cd-c8e6-47d3-9735-3d83421b3ad8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"
Sep 10 19:21:21.100551 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.100529    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:21.107416 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.107392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c8ps\" (UniqueName: \"kubernetes.io/projected/b30c88a5-d90d-4b16-98a9-c673fabda0d6-kube-api-access-9c8ps\") pod \"downloads-85d98c998f-mcf7h\" (UID: \"b30c88a5-d90d-4b16-98a9-c673fabda0d6\") " pod="openshift-console/downloads-85d98c998f-mcf7h"
Sep 10 19:21:21.172384 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.172334    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"
Sep 10 19:21:21.180989 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.180963    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-mcf7h"
Sep 10 19:21:21.196016 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.195987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58085a60-fe26-40c7-9901-100acd34c1d6-installation-pull-secrets\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196142 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrrg\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-kube-api-access-7lrrg\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196142 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-registry-tls\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196142 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58085a60-fe26-40c7-9901-100acd34c1d6-image-registry-private-configuration\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196142 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58085a60-fe26-40c7-9901-100acd34c1d6-ca-trust-extracted\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58085a60-fe26-40c7-9901-100acd34c1d6-trusted-ca\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58085a60-fe26-40c7-9901-100acd34c1d6-registry-certificates\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-bound-sa-token\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.196880 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.196793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58085a60-fe26-40c7-9901-100acd34c1d6-ca-trust-extracted\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.197298 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.197273    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58085a60-fe26-40c7-9901-100acd34c1d6-trusted-ca\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.197401 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.197300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58085a60-fe26-40c7-9901-100acd34c1d6-registry-certificates\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.199309 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.199284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58085a60-fe26-40c7-9901-100acd34c1d6-installation-pull-secrets\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.199417 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.199340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-registry-tls\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.199417 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.199357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58085a60-fe26-40c7-9901-100acd34c1d6-image-registry-private-configuration\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.204927 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.204904    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-bound-sa-token\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.205978 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.205955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrrg\" (UniqueName: \"kubernetes.io/projected/58085a60-fe26-40c7-9901-100acd34c1d6-kube-api-access-7lrrg\") pod \"image-registry-595d9c976d-jht75\" (UID: \"58085a60-fe26-40c7-9901-100acd34c1d6\") " pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:21.300083 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:21.299993    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:23.799922 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.799875    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s"]
Sep 10 19:21:23.800901 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:23.800879    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0365ce21_4d85_45d9_8cb2_549f1f45bf2d.slice/crio-ac9472da8123aa26e73a3341c83bc0f5437f9bb118d5b7f5f606ce289110f8cd WatchSource:0}: Error finding container ac9472da8123aa26e73a3341c83bc0f5437f9bb118d5b7f5f606ce289110f8cd: Status 404 returned error can't find the container with id ac9472da8123aa26e73a3341c83bc0f5437f9bb118d5b7f5f606ce289110f8cd
Sep 10 19:21:23.805952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.805926    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-mcf7h"]
Sep 10 19:21:23.808713 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:23.808676    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30c88a5_d90d_4b16_98a9_c673fabda0d6.slice/crio-c79057ebcc8e96e348f61c2e6413aeccf71365dd4fecbc7f33c74b92bb44bb79 WatchSource:0}: Error finding container c79057ebcc8e96e348f61c2e6413aeccf71365dd4fecbc7f33c74b92bb44bb79: Status 404 returned error can't find the container with id c79057ebcc8e96e348f61c2e6413aeccf71365dd4fecbc7f33c74b92bb44bb79
Sep 10 19:21:23.809097 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.809080    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"]
Sep 10 19:21:23.811731 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.811711    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"]
Sep 10 19:21:23.812579 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:23.812559    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb631764d_5879_43d0_82dd_cd49128a142e.slice/crio-f7f0632e888250bd111f987e8ca4d7ad73ac5e8f0f5ad4b1a9ed0dde4639db10 WatchSource:0}: Error finding container f7f0632e888250bd111f987e8ca4d7ad73ac5e8f0f5ad4b1a9ed0dde4639db10: Status 404 returned error can't find the container with id f7f0632e888250bd111f987e8ca4d7ad73ac5e8f0f5ad4b1a9ed0dde4639db10
Sep 10 19:21:23.814991 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.814933    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-595d9c976d-jht75"]
Sep 10 19:21:23.815342 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:23.815217    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc595cd_c8e6_47d3_9735_3d83421b3ad8.slice/crio-c80b02594ffa3d17e069a9fd7a5d1e13af268fc7fa94259eb15e869de4e6a436 WatchSource:0}: Error finding container c80b02594ffa3d17e069a9fd7a5d1e13af268fc7fa94259eb15e869de4e6a436: Status 404 returned error can't find the container with id c80b02594ffa3d17e069a9fd7a5d1e13af268fc7fa94259eb15e869de4e6a436
Sep 10 19:21:23.819135 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:23.819109    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58085a60_fe26_40c7_9901_100acd34c1d6.slice/crio-0ff06ead9f152f93e768a721989290ddf8a8f6228a01340361d3544db6edd5ec WatchSource:0}: Error finding container 0ff06ead9f152f93e768a721989290ddf8a8f6228a01340361d3544db6edd5ec: Status 404 returned error can't find the container with id 0ff06ead9f152f93e768a721989290ddf8a8f6228a01340361d3544db6edd5ec
Sep 10 19:21:23.964053 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.964014    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-mcf7h" event={"ID":"b30c88a5-d90d-4b16-98a9-c673fabda0d6","Type":"ContainerStarted","Data":"c79057ebcc8e96e348f61c2e6413aeccf71365dd4fecbc7f33c74b92bb44bb79"}
Sep 10 19:21:23.965270 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.965235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh" event={"ID":"2bc595cd-c8e6-47d3-9735-3d83421b3ad8","Type":"ContainerStarted","Data":"c80b02594ffa3d17e069a9fd7a5d1e13af268fc7fa94259eb15e869de4e6a436"}
Sep 10 19:21:23.966809 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.966774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwds8" event={"ID":"d73d1992-e3e8-46c7-9a80-ee3a2fb672ea","Type":"ContainerStarted","Data":"abe4857964d52dc111d73e48b5a48ba8fc26674dda0fd6295117723f3f10da6d"}
Sep 10 19:21:23.968015 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.967994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt" event={"ID":"b631764d-5879-43d0-82dd-cd49128a142e","Type":"ContainerStarted","Data":"f7f0632e888250bd111f987e8ca4d7ad73ac5e8f0f5ad4b1a9ed0dde4639db10"}
Sep 10 19:21:23.969311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.969290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8btsb" event={"ID":"303175c3-e49f-4cdc-bf40-73d0a90e2341","Type":"ContainerStarted","Data":"07c0dc9e373e6ebabb1875c77609f348ee6067e4a6fa39e8048fda013632658d"}
Sep 10 19:21:23.969429 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.969406    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:21:23.970461 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.970435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s" event={"ID":"0365ce21-4d85-45d9-8cb2-549f1f45bf2d","Type":"ContainerStarted","Data":"ac9472da8123aa26e73a3341c83bc0f5437f9bb118d5b7f5f606ce289110f8cd"}
Sep 10 19:21:23.971873 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.971851    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595d9c976d-jht75" event={"ID":"58085a60-fe26-40c7-9901-100acd34c1d6","Type":"ContainerStarted","Data":"6fc70c2d46fad2cc04386b343baede8f34d22392141a888de0f85b6a87a757d6"}
Sep 10 19:21:23.971970 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.971889    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-595d9c976d-jht75" event={"ID":"58085a60-fe26-40c7-9901-100acd34c1d6","Type":"ContainerStarted","Data":"0ff06ead9f152f93e768a721989290ddf8a8f6228a01340361d3544db6edd5ec"}
Sep 10 19:21:23.972034 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.971975    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:23.982916 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:23.982847    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kwds8" podStartSLOduration=67.326056497 podStartE2EDuration="1m12.982829895s" totalImagesPullingTime="5.656773398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:23.982764411 +0000 UTC m=+72.799374024" watchObservedRunningTime="2026-09-10 19:21:23.982829895 +0000 UTC m=+72.799439464"
Sep 10 19:21:24.002505 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:24.002459    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-595d9c976d-jht75" podStartSLOduration=4.002446736 podStartE2EDuration="4.002446736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:24.002311214 +0000 UTC m=+72.818920781" watchObservedRunningTime="2026-09-10 19:21:24.002446736 +0000 UTC m=+72.819056304"
Sep 10 19:21:24.017103 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:24.017060    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8btsb" podStartSLOduration=67.694607666 podStartE2EDuration="1m13.01704479s" totalImagesPullingTime="5.322437124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:24.015851146 +0000 UTC m=+72.832460731" watchObservedRunningTime="2026-09-10 19:21:24.01704479 +0000 UTC m=+72.833654398"
Sep 10 19:21:25.984860 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:25.984434    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh" event={"ID":"2bc595cd-c8e6-47d3-9735-3d83421b3ad8","Type":"ContainerStarted","Data":"1f0c496b0108f2ad6883fece98a3519951dd9a2ac7c5300457ff731ed6cbb475"}
Sep 10 19:21:25.984860 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:25.984798    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"
Sep 10 19:21:25.991970 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:25.991932    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh"
Sep 10 19:21:26.015794 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:26.014789    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5qdzh" podStartSLOduration=4.345278707 podStartE2EDuration="6.014768304s" totalImagesPullingTime="1.669489597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:25.999754859 +0000 UTC m=+74.816364455" watchObservedRunningTime="2026-09-10 19:21:26.014768304 +0000 UTC m=+74.831377874"
Sep 10 19:21:29.955317 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:29.955283    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wzfcj"
Sep 10 19:21:30.003212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:30.003152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s" event={"ID":"0365ce21-4d85-45d9-8cb2-549f1f45bf2d","Type":"ContainerStarted","Data":"d9fa336875ecac2a962a49033c5c71c6ca767f75cf9960b93db1d64bddd0d53b"}
Sep 10 19:21:30.004930 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:30.004904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt" event={"ID":"b631764d-5879-43d0-82dd-cd49128a142e","Type":"ContainerStarted","Data":"0b03d347e6b953b5796217f5d61775b885ea51a4db5c8419a6205604bfb09b44"}
Sep 10 19:21:30.005325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:30.005308    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:30.007207 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:30.007184    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt"
Sep 10 19:21:30.018789 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:30.018743    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76559c4496-ttl8s" podStartSLOduration=4.354447735 podStartE2EDuration="10.018726871s" totalImagesPullingTime="5.664279136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:30.017564847 +0000 UTC m=+78.834174416" watchObservedRunningTime="2026-09-10 19:21:30.018726871 +0000 UTC m=+78.835336438"
Sep 10 19:21:30.036018 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:30.035953    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dc6d444-lwgtt" podStartSLOduration=4.367401191 podStartE2EDuration="10.035934836s" totalImagesPullingTime="5.668533645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:30.034668165 +0000 UTC m=+78.851277755" watchObservedRunningTime="2026-09-10 19:21:30.035934836 +0000 UTC m=+78.852544406"
Sep 10 19:21:33.560927 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.560892    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"]
Sep 10 19:21:33.563334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.563307    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.566502 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.566474    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 19:21:33.566643 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.566465    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 19:21:33.566643 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.566576    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 19:21:33.566643 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.566489    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 19:21:33.566826 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.566574    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 19:21:33.567127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.567108    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6lrsn\""
Sep 10 19:21:33.567127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.567118    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 19:21:33.579018 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.578971    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"]
Sep 10 19:21:33.580368 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.580343    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fc84z"]
Sep 10 19:21:33.582862 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.582841    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.585118 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.585098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dvs6s\""
Sep 10 19:21:33.585261 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.585151    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 19:21:33.585336 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.585208    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 19:21:33.585336 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.585267    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 19:21:33.700030 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.699893    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9448b03-7fd6-4e30-9035-8cb7f43e475f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.700030 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.699936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf92c\" (UniqueName: \"kubernetes.io/projected/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-kube-api-access-kf92c\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700030 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.699958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-sys\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700030 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-textfile\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-metrics-client-ca\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr6pw\" (UniqueName: \"kubernetes.io/projected/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-api-access-lr6pw\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700176    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-wtmp\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-tls\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-accelerators-collector-config\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9448b03-7fd6-4e30-9035-8cb7f43e475f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-root\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.700499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.700345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.801696 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.801661    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-wtmp\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.801857 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.801714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.801857 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.801764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-tls\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.801857 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.801797    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-accelerators-collector-config\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.801857 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.801826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9448b03-7fd6-4e30-9035-8cb7f43e475f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.802076 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.801887    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-wtmp\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.802528 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:33.802496    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 19:21:33.802660 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802565    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-root\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.802660 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:33.802586    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-tls podName:9483c9a1-3e07-48eb-b8ff-48a0d090fc59 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:34.302560509 +0000 UTC m=+83.119170058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-tls") pod "node-exporter-fc84z" (UID: "9483c9a1-3e07-48eb-b8ff-48a0d090fc59") : secret "node-exporter-tls" not found
Sep 10 19:21:33.802660 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-root\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.802660 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.802854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9448b03-7fd6-4e30-9035-8cb7f43e475f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.802854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf92c\" (UniqueName: \"kubernetes.io/projected/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-kube-api-access-kf92c\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.802854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-sys\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.802854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.802854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.803092 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-textfile\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.803092 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-metrics-client-ca\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.803092 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.802940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr6pw\" (UniqueName: \"kubernetes.io/projected/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-api-access-lr6pw\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.803352 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.803328    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9448b03-7fd6-4e30-9035-8cb7f43e475f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.803462 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.803351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9448b03-7fd6-4e30-9035-8cb7f43e475f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.803462 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.803261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-accelerators-collector-config\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.803462 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.803418    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-sys\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.803612 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.803501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-textfile\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.803988 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.803945    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-metrics-client-ca\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.804101 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.804057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.805663 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.805635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.806200 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.806179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.806268 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.806248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.813016 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.812950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf92c\" (UniqueName: \"kubernetes.io/projected/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-kube-api-access-kf92c\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:33.813354 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.813333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr6pw\" (UniqueName: \"kubernetes.io/projected/e9448b03-7fd6-4e30-9035-8cb7f43e475f-kube-api-access-lr6pw\") pod \"kube-state-metrics-74cb57df7-hfkn4\" (UID: \"e9448b03-7fd6-4e30-9035-8cb7f43e475f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:33.874478 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:33.874444    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"
Sep 10 19:21:34.152738 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.152665    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4"]
Sep 10 19:21:34.307387 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.307336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-tls\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:34.309817 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.309794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9483c9a1-3e07-48eb-b8ff-48a0d090fc59-node-exporter-tls\") pod \"node-exporter-fc84z\" (UID: \"9483c9a1-3e07-48eb-b8ff-48a0d090fc59\") " pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:34.494413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.494348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fc84z"
Sep 10 19:21:34.610550 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.610505    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:21:34.615073 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.615044    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.617499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.617474    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 19:21:34.617632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.617477    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 19:21:34.617632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.617531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 19:21:34.617828 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.617807    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 19:21:34.617940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.617837    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 19:21:34.618123 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.618106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 19:21:34.618213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.618183    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 19:21:34.618274 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.618218    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 19:21:34.618274 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.618231    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c79ml\""
Sep 10 19:21:34.618274 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.618244    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 19:21:34.626044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.626020    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:21:34.714229 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714195    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714229 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714466 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714466 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-volume\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714466 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714466 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714466 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-web-config\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714697 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714697 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714697 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714600    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714697 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-out\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714697 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.714919 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.714727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhz4g\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-kube-api-access-fhz4g\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815405 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815307    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815405 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-volume\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815451    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-web-config\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-out\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhz4g\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-kube-api-access-fhz4g\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.815952 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:34.815872    2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 10 19:21:34.815952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.815946    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.816354 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:21:34.815955    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls podName:09b22f2f-d15a-4af5-b623-7ffe70dd7199 nodeName:}" failed. No retries permitted until 2026-09-10 19:21:35.315927086 +0000 UTC m=+84.132536634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199") : secret "alertmanager-main-tls" not found
Sep 10 19:21:34.817595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.817565    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.818573 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.818504    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.818950 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.818912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-volume\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.819207 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.819183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.819315 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.819187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.819315 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.819238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.819445 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.819347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.819581 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.819542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-web-config\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.819676 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.819589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-out\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.820919 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.820898    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:34.824305 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:34.824281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhz4g\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-kube-api-access-fhz4g\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:35.320283 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:35.320244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:35.322945 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:35.322917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:35.526958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:35.526923    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:21:37.854035 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.854001    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-95f56ccd-7zksc"]
Sep 10 19:21:37.856187 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.856169    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:37.859408 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.859360    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 19:21:37.859519 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.859422    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 19:21:37.860101 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.860081    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 19:21:37.860412 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.860297    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 19:21:37.860412 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.860317    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4afi6q4ddo60v\""
Sep 10 19:21:37.860578 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.860428    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b7xwj\""
Sep 10 19:21:37.867877 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.867856    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-95f56ccd-7zksc"]
Sep 10 19:21:37.943659 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.943630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-secret-metrics-server-tls\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:37.943659 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.943669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z69z6\" (UniqueName: \"kubernetes.io/projected/0881fa70-ae08-414e-90dc-8cee994c69bb-kube-api-access-z69z6\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:37.943882 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.943703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-client-ca-bundle\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:37.943882 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.943800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0881fa70-ae08-414e-90dc-8cee994c69bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:37.943984 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.943896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0881fa70-ae08-414e-90dc-8cee994c69bb-metrics-server-audit-profiles\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:37.943984 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.943934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0881fa70-ae08-414e-90dc-8cee994c69bb-audit-log\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:37.943984 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:37.943961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-secret-metrics-server-client-certs\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.045180 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.045150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0881fa70-ae08-414e-90dc-8cee994c69bb-metrics-server-audit-profiles\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.045353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.045205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0881fa70-ae08-414e-90dc-8cee994c69bb-audit-log\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.045353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.045242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-secret-metrics-server-client-certs\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.045353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.045280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-secret-metrics-server-tls\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.045353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.045304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z69z6\" (UniqueName: \"kubernetes.io/projected/0881fa70-ae08-414e-90dc-8cee994c69bb-kube-api-access-z69z6\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.045353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.045331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-client-ca-bundle\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.045353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.045349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0881fa70-ae08-414e-90dc-8cee994c69bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.046217 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.046177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0881fa70-ae08-414e-90dc-8cee994c69bb-audit-log\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.047348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.046724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0881fa70-ae08-414e-90dc-8cee994c69bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.047348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.046765    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0881fa70-ae08-414e-90dc-8cee994c69bb-metrics-server-audit-profiles\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.052000 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.051925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-secret-metrics-server-tls\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.052000 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.051927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-secret-metrics-server-client-certs\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.054020 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.053992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0881fa70-ae08-414e-90dc-8cee994c69bb-client-ca-bundle\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.055078 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.055054    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z69z6\" (UniqueName: \"kubernetes.io/projected/0881fa70-ae08-414e-90dc-8cee994c69bb-kube-api-access-z69z6\") pod \"metrics-server-95f56ccd-7zksc\" (UID: \"0881fa70-ae08-414e-90dc-8cee994c69bb\") " pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:38.167357 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:38.167230    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:40.818662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:40.818621    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:41.094662 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:41.094592    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9448b03_7fd6_4e30_9035_8cb7f43e475f.slice/crio-35061c9ca7d50fef40a7dc6aaddf5530452312f0e3ec4b1ec61c8d8afb5fc717 WatchSource:0}: Error finding container 35061c9ca7d50fef40a7dc6aaddf5530452312f0e3ec4b1ec61c8d8afb5fc717: Status 404 returned error can't find the container with id 35061c9ca7d50fef40a7dc6aaddf5530452312f0e3ec4b1ec61c8d8afb5fc717
Sep 10 19:21:41.110718 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:41.110689    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9483c9a1_3e07_48eb_b8ff_48a0d090fc59.slice/crio-ca248b8336f439710fa428f5486277bd85e15c7111f1a055cb075a8675f52716 WatchSource:0}: Error finding container ca248b8336f439710fa428f5486277bd85e15c7111f1a055cb075a8675f52716: Status 404 returned error can't find the container with id ca248b8336f439710fa428f5486277bd85e15c7111f1a055cb075a8675f52716
Sep 10 19:21:41.372495 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:41.372473    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-95f56ccd-7zksc"]
Sep 10 19:21:41.383170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:41.383141    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:21:41.421348 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:41.421315    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0881fa70_ae08_414e_90dc_8cee994c69bb.slice/crio-494e82c9502e27390b280f3edefdfdf7e33d1dc4145cb9adc4a7ee6ba5f054d1 WatchSource:0}: Error finding container 494e82c9502e27390b280f3edefdfdf7e33d1dc4145cb9adc4a7ee6ba5f054d1: Status 404 returned error can't find the container with id 494e82c9502e27390b280f3edefdfdf7e33d1dc4145cb9adc4a7ee6ba5f054d1
Sep 10 19:21:41.421986 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:21:41.421911    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b22f2f_d15a_4af5_b623_7ffe70dd7199.slice/crio-f9914cd7f8e1ec23f02b0274d1286266ba257ed7b7529a5653db096b7b750f00 WatchSource:0}: Error finding container f9914cd7f8e1ec23f02b0274d1286266ba257ed7b7529a5653db096b7b750f00: Status 404 returned error can't find the container with id f9914cd7f8e1ec23f02b0274d1286266ba257ed7b7529a5653db096b7b750f00
Sep 10 19:21:42.052512 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.052459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc" event={"ID":"0881fa70-ae08-414e-90dc-8cee994c69bb","Type":"ContainerStarted","Data":"494e82c9502e27390b280f3edefdfdf7e33d1dc4145cb9adc4a7ee6ba5f054d1"}
Sep 10 19:21:42.054251 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.054218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4" event={"ID":"e9448b03-7fd6-4e30-9035-8cb7f43e475f","Type":"ContainerStarted","Data":"35061c9ca7d50fef40a7dc6aaddf5530452312f0e3ec4b1ec61c8d8afb5fc717"}
Sep 10 19:21:42.056403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.056357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-mcf7h" event={"ID":"b30c88a5-d90d-4b16-98a9-c673fabda0d6","Type":"ContainerStarted","Data":"f186ab8f8400f4f08422d70cc42d66f723bf9b78df8fdc0384505bdc8053c56e"}
Sep 10 19:21:42.057029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.056938    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-mcf7h"
Sep 10 19:21:42.059178 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.058984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerStarted","Data":"f9914cd7f8e1ec23f02b0274d1286266ba257ed7b7529a5653db096b7b750f00"}
Sep 10 19:21:42.060851 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.060826    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fc84z" event={"ID":"9483c9a1-3e07-48eb-b8ff-48a0d090fc59","Type":"ContainerStarted","Data":"ca248b8336f439710fa428f5486277bd85e15c7111f1a055cb075a8675f52716"}
Sep 10 19:21:42.073985 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.073856    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-mcf7h"
Sep 10 19:21:42.076818 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:42.075821    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-mcf7h" podStartSLOduration=4.391389424 podStartE2EDuration="22.075802428s" totalImagesPullingTime="17.684413004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:42.073946322 +0000 UTC m=+90.890555929" watchObservedRunningTime="2026-09-10 19:21:42.075802428 +0000 UTC m=+90.892411999"
Sep 10 19:21:44.983615 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:44.983584    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-595d9c976d-jht75"
Sep 10 19:21:45.839988 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:45.839909    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh" podUID="afcc8dc0-a090-4960-88b6-539924a604c3" containerName="registry" containerID="cri-o://5014684a618bf1ad8de4d6fb7ba6002a6a5ee319eeb3dc8c4a10f9ac3e21eefc" gracePeriod=30
Sep 10 19:21:46.093059 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.093020    2558 generic.go:356] "Generic (PLEG): container finished" podID="9483c9a1-3e07-48eb-b8ff-48a0d090fc59" containerID="160f71919176acdf230c0e6e3b121f7b8a25526a7c82ef2edfacec290ea0cdd0" exitCode=0
Sep 10 19:21:46.093472 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.093127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fc84z" event={"ID":"9483c9a1-3e07-48eb-b8ff-48a0d090fc59","Type":"ContainerDied","Data":"160f71919176acdf230c0e6e3b121f7b8a25526a7c82ef2edfacec290ea0cdd0"}
Sep 10 19:21:46.096489 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.096460    2558 generic.go:356] "Generic (PLEG): container finished" podID="afcc8dc0-a090-4960-88b6-539924a604c3" containerID="5014684a618bf1ad8de4d6fb7ba6002a6a5ee319eeb3dc8c4a10f9ac3e21eefc" exitCode=0
Sep 10 19:21:46.096641 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.096522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh" event={"ID":"afcc8dc0-a090-4960-88b6-539924a604c3","Type":"ContainerDied","Data":"5014684a618bf1ad8de4d6fb7ba6002a6a5ee319eeb3dc8c4a10f9ac3e21eefc"}
Sep 10 19:21:46.098214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.098171    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc" event={"ID":"0881fa70-ae08-414e-90dc-8cee994c69bb","Type":"ContainerStarted","Data":"863a6ca62529f56f201b401123abe0e415b45fd0220f5e7a81aaacecf40147f9"}
Sep 10 19:21:46.100317 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.100297    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4" event={"ID":"e9448b03-7fd6-4e30-9035-8cb7f43e475f","Type":"ContainerStarted","Data":"3e758baf653e0c274ae96c8fd1427d33944d3e8235334bb144c832eda7a03dc6"}
Sep 10 19:21:46.100452 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.100336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4" event={"ID":"e9448b03-7fd6-4e30-9035-8cb7f43e475f","Type":"ContainerStarted","Data":"1d3d9d3a249122244096bb54e4a295c9b005086c94ff6c87b081dca2fe016d3a"}
Sep 10 19:21:46.100452 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.100355    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4" event={"ID":"e9448b03-7fd6-4e30-9035-8cb7f43e475f","Type":"ContainerStarted","Data":"3581ebd1015e1beb1927bbf0f1b4b25f0fcc9f3b155544007883b935883dc086"}
Sep 10 19:21:46.102456 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.102358    2558 generic.go:356] "Generic (PLEG): container finished" podID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerID="83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de" exitCode=0
Sep 10 19:21:46.102456 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.102405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de"}
Sep 10 19:21:46.145010 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.144986    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:46.185088 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.184657    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hfkn4" podStartSLOduration=9.199724412 podStartE2EDuration="13.184637659s" totalImagesPullingTime="3.984913247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:46.182619022 +0000 UTC m=+94.999228631" watchObservedRunningTime="2026-09-10 19:21:46.184637659 +0000 UTC m=+95.001247228"
Sep 10 19:21:46.203340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.203283    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc" podStartSLOduration=5.568854195 podStartE2EDuration="9.203262497s" totalImagesPullingTime="3.634408302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:46.202397073 +0000 UTC m=+95.019006640" watchObservedRunningTime="2026-09-10 19:21:46.203262497 +0000 UTC m=+95.019872068"
Sep 10 19:21:46.222835 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.222809    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8dc0-a090-4960-88b6-539924a604c3-ca-trust-extracted\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.222949 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.222859    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-registry-certificates\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.222949 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.222888    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-image-registry-private-configuration\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.222949 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.222917    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-trusted-ca\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.223161 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.222955    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-installation-pull-secrets\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.224188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.223253    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.224188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.223303    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-bound-sa-token\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.224188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.223314    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:21:46.224188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.223328    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kj2r\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-kube-api-access-6kj2r\") pod \"afcc8dc0-a090-4960-88b6-539924a604c3\" (UID: \"afcc8dc0-a090-4960-88b6-539924a604c3\") "
Sep 10 19:21:46.224188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.223773    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-registry-certificates\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:46.224188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.224151    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:21:46.226016 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.225971    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:21:46.226482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.226461    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:21:46.228711 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.228672    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:21:46.229073 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.229047    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:21:46.230056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.230026    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-kube-api-access-6kj2r" (OuterVolumeSpecName: "kube-api-access-6kj2r") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "kube-api-access-6kj2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:21:46.236980 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.236953    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afcc8dc0-a090-4960-88b6-539924a604c3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "afcc8dc0-a090-4960-88b6-539924a604c3" (UID: "afcc8dc0-a090-4960-88b6-539924a604c3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:21:46.325048 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.325022    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8dc0-a090-4960-88b6-539924a604c3-ca-trust-extracted\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:46.325048 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.325047    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-image-registry-private-configuration\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:46.325214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.325063    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8dc0-a090-4960-88b6-539924a604c3-trusted-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:46.325214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.325076    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8dc0-a090-4960-88b6-539924a604c3-installation-pull-secrets\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:46.325214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.325086    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-registry-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:46.325214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.325094    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-bound-sa-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:46.325214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:46.325103    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kj2r\" (UniqueName: \"kubernetes.io/projected/afcc8dc0-a090-4960-88b6-539924a604c3-kube-api-access-6kj2r\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:21:47.111286 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.111026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fc84z" event={"ID":"9483c9a1-3e07-48eb-b8ff-48a0d090fc59","Type":"ContainerStarted","Data":"2f0f3a27ceab39cdb0a74d400cfcf1e9831b73d98e3fb512b2565c684f46333b"}
Sep 10 19:21:47.111286 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.111089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fc84z" event={"ID":"9483c9a1-3e07-48eb-b8ff-48a0d090fc59","Type":"ContainerStarted","Data":"ac7bcbe0a5e14d63cbbc701ad368058f22ae64218e4eb34c0691fe11db9dea58"}
Sep 10 19:21:47.112556 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.112530    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh"
Sep 10 19:21:47.112681 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.112580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5547b54c79-nlwdh" event={"ID":"afcc8dc0-a090-4960-88b6-539924a604c3","Type":"ContainerDied","Data":"b0fa17d9e515eade4346bf7782a3679a58f4d47aab10ebd1dde648ae0eb89b13"}
Sep 10 19:21:47.112681 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.112638    2558 scope.go:117] "RemoveContainer" containerID="5014684a618bf1ad8de4d6fb7ba6002a6a5ee319eeb3dc8c4a10f9ac3e21eefc"
Sep 10 19:21:47.169394 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.169306    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fc84z" podStartSLOduration=10.102010054 podStartE2EDuration="14.169285572s" totalImagesPullingTime="3.969379242s" totalInitContainerRuntime="97.896276ms" isStatefulPod=true podCreationTimestamp="2026-09-10 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:47.165874539 +0000 UTC m=+95.982484130" watchObservedRunningTime="2026-09-10 19:21:47.169285572 +0000 UTC m=+95.985895139"
Sep 10 19:21:47.200658 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.200619    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5547b54c79-nlwdh"]
Sep 10 19:21:47.212097 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.212062    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5547b54c79-nlwdh"]
Sep 10 19:21:47.654787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:47.654752    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afcc8dc0-a090-4960-88b6-539924a604c3" path="/var/lib/kubelet/pods/afcc8dc0-a090-4960-88b6-539924a604c3/volumes"
Sep 10 19:21:49.125898 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:49.125869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerStarted","Data":"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"}
Sep 10 19:21:49.126259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:49.125949    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerStarted","Data":"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"}
Sep 10 19:21:49.126259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:49.125995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerStarted","Data":"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"}
Sep 10 19:21:50.134190 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:50.134153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerStarted","Data":"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"}
Sep 10 19:21:50.134604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:50.134225    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerStarted","Data":"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"}
Sep 10 19:21:51.141538 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:51.141459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerStarted","Data":"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"}
Sep 10 19:21:51.167283 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:51.167219    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.545302654 podStartE2EDuration="17.167198952s" totalImagesPullingTime="7.580670092s" totalInitContainerRuntime="41.226206ms" isStatefulPod=false podCreationTimestamp="2026-09-10 19:21:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:21:51.165084165 +0000 UTC m=+99.981693733" watchObservedRunningTime="2026-09-10 19:21:51.167198952 +0000 UTC m=+99.983808520"
Sep 10 19:21:54.980524 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:54.980491    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8btsb"
Sep 10 19:21:58.167811 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:58.167780    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:21:58.168266 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:21:58.167829    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:22:18.172811 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:18.172779    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:22:18.176513 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:18.176475    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-95f56ccd-7zksc"
Sep 10 19:22:54.016351 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.016312    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:22:54.016932 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.016671    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="alertmanager" containerID="cri-o://19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c" gracePeriod=120
Sep 10 19:22:54.016932 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.016749    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-metric" containerID="cri-o://1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453" gracePeriod=120
Sep 10 19:22:54.016932 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.016799    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="config-reloader" containerID="cri-o://a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe" gracePeriod=120
Sep 10 19:22:54.016932 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.016749    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-web" containerID="cri-o://ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29" gracePeriod=120
Sep 10 19:22:54.016932 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.016799    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy" containerID="cri-o://a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5" gracePeriod=120
Sep 10 19:22:54.017203 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.016842    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="prom-label-proxy" containerID="cri-o://b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099" gracePeriod=120
Sep 10 19:22:54.367465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367369    2558 generic.go:356] "Generic (PLEG): container finished" podID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerID="b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099" exitCode=0
Sep 10 19:22:54.367465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367409    2558 generic.go:356] "Generic (PLEG): container finished" podID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerID="a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5" exitCode=0
Sep 10 19:22:54.367465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367406    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"}
Sep 10 19:22:54.367677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"}
Sep 10 19:22:54.367677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367416    2558 generic.go:356] "Generic (PLEG): container finished" podID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerID="a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe" exitCode=0
Sep 10 19:22:54.367677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367498    2558 generic.go:356] "Generic (PLEG): container finished" podID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerID="19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c" exitCode=0
Sep 10 19:22:54.367677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367504    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"}
Sep 10 19:22:54.367677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:54.367532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"}
Sep 10 19:22:55.252584 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.252560    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.371466 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371365    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-trusted-ca-bundle\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371592 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371507    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-cluster-tls-config\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371592 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371542    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-web\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371592 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371582    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-out\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371610    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371642    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-web-config\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371673    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-main-db\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371699    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-volume\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371725    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:22:55.371917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371746    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-metrics-client-ca\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371780    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-metric\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371805    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-tls-assets\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371828    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhz4g\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-kube-api-access-fhz4g\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.371917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.371870    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls\") pod \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\" (UID: \"09b22f2f-d15a-4af5-b623-7ffe70dd7199\") "
Sep 10 19:22:55.372210 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.372073    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.372636 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.372324    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:22:55.373431 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.373402    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:22:55.375408 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.375251    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-out" (OuterVolumeSpecName: "config-out") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:22:55.375408 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.375307    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:22:55.375408 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.375354    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:22:55.376215 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376167    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:22:55.376309 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376277    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-kube-api-access-fhz4g" (OuterVolumeSpecName: "kube-api-access-fhz4g") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "kube-api-access-fhz4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:22:55.376718 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376693    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:22:55.376803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376717    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-volume" (OuterVolumeSpecName: "config-volume") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:22:55.376803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376740    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:22:55.376803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376747    2558 generic.go:356] "Generic (PLEG): container finished" podID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerID="1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453" exitCode=0
Sep 10 19:22:55.376803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376765    2558 generic.go:356] "Generic (PLEG): container finished" podID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerID="ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29" exitCode=0
Sep 10 19:22:55.376803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"}
Sep 10 19:22:55.377064 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"}
Sep 10 19:22:55.377064 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376846    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.377064 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376888    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09b22f2f-d15a-4af5-b623-7ffe70dd7199","Type":"ContainerDied","Data":"f9914cd7f8e1ec23f02b0274d1286266ba257ed7b7529a5653db096b7b750f00"}
Sep 10 19:22:55.377064 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.376931    2558 scope.go:117] "RemoveContainer" containerID="b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"
Sep 10 19:22:55.379180 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.379154    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:22:55.385814 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.385794    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-web-config" (OuterVolumeSpecName: "web-config") pod "09b22f2f-d15a-4af5-b623-7ffe70dd7199" (UID: "09b22f2f-d15a-4af5-b623-7ffe70dd7199"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:22:55.386843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.386827    2558 scope.go:117] "RemoveContainer" containerID="1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"
Sep 10 19:22:55.393034 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.393019    2558 scope.go:117] "RemoveContainer" containerID="a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"
Sep 10 19:22:55.399245 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.399232    2558 scope.go:117] "RemoveContainer" containerID="ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"
Sep 10 19:22:55.405281 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.405259    2558 scope.go:117] "RemoveContainer" containerID="a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"
Sep 10 19:22:55.411272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.411254    2558 scope.go:117] "RemoveContainer" containerID="19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"
Sep 10 19:22:55.417768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.417753    2558 scope.go:117] "RemoveContainer" containerID="83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de"
Sep 10 19:22:55.423986 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.423971    2558 scope.go:117] "RemoveContainer" containerID="b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"
Sep 10 19:22:55.424245 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:22:55.424227    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099\": container with ID starting with b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099 not found: ID does not exist" containerID="b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"
Sep 10 19:22:55.424301 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.424253    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"} err="failed to get container status \"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099\": rpc error: code = NotFound desc = could not find container \"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099\": container with ID starting with b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099 not found: ID does not exist"
Sep 10 19:22:55.424301 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.424282    2558 scope.go:117] "RemoveContainer" containerID="1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"
Sep 10 19:22:55.424529 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:22:55.424505    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453\": container with ID starting with 1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453 not found: ID does not exist" containerID="1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"
Sep 10 19:22:55.424573 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.424533    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"} err="failed to get container status \"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453\": rpc error: code = NotFound desc = could not find container \"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453\": container with ID starting with 1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453 not found: ID does not exist"
Sep 10 19:22:55.424573 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.424547    2558 scope.go:117] "RemoveContainer" containerID="a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"
Sep 10 19:22:55.424779 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:22:55.424761    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5\": container with ID starting with a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5 not found: ID does not exist" containerID="a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"
Sep 10 19:22:55.424824 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.424784    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"} err="failed to get container status \"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5\": rpc error: code = NotFound desc = could not find container \"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5\": container with ID starting with a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5 not found: ID does not exist"
Sep 10 19:22:55.424824 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.424805    2558 scope.go:117] "RemoveContainer" containerID="ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"
Sep 10 19:22:55.425017 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:22:55.425001    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29\": container with ID starting with ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29 not found: ID does not exist" containerID="ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"
Sep 10 19:22:55.425059 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425020    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"} err="failed to get container status \"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29\": rpc error: code = NotFound desc = could not find container \"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29\": container with ID starting with ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29 not found: ID does not exist"
Sep 10 19:22:55.425059 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425032    2558 scope.go:117] "RemoveContainer" containerID="a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"
Sep 10 19:22:55.425238 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:22:55.425225    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe\": container with ID starting with a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe not found: ID does not exist" containerID="a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"
Sep 10 19:22:55.425277 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425240    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"} err="failed to get container status \"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe\": rpc error: code = NotFound desc = could not find container \"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe\": container with ID starting with a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe not found: ID does not exist"
Sep 10 19:22:55.425277 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425251    2558 scope.go:117] "RemoveContainer" containerID="19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"
Sep 10 19:22:55.425481 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:22:55.425462    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c\": container with ID starting with 19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c not found: ID does not exist" containerID="19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"
Sep 10 19:22:55.425525 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425484    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"} err="failed to get container status \"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c\": rpc error: code = NotFound desc = could not find container \"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c\": container with ID starting with 19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c not found: ID does not exist"
Sep 10 19:22:55.425525 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425499    2558 scope.go:117] "RemoveContainer" containerID="83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de"
Sep 10 19:22:55.425719 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:22:55.425703    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de\": container with ID starting with 83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de not found: ID does not exist" containerID="83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de"
Sep 10 19:22:55.425764 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425722    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de"} err="failed to get container status \"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de\": rpc error: code = NotFound desc = could not find container \"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de\": container with ID starting with 83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de not found: ID does not exist"
Sep 10 19:22:55.425764 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425734    2558 scope.go:117] "RemoveContainer" containerID="b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"
Sep 10 19:22:55.425928 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425913    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099"} err="failed to get container status \"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099\": rpc error: code = NotFound desc = could not find container \"b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099\": container with ID starting with b9f1fa422240b481e0ced7020eedb54d8b4da830a75a66d9d30079830c255099 not found: ID does not exist"
Sep 10 19:22:55.425968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.425928    2558 scope.go:117] "RemoveContainer" containerID="1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"
Sep 10 19:22:55.426107 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426093    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453"} err="failed to get container status \"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453\": rpc error: code = NotFound desc = could not find container \"1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453\": container with ID starting with 1072ee7a0884462273173aa560f16d013f6b45061a48076ff7d10ae46bac3453 not found: ID does not exist"
Sep 10 19:22:55.426147 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426107    2558 scope.go:117] "RemoveContainer" containerID="a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"
Sep 10 19:22:55.426317 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426297    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5"} err="failed to get container status \"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5\": rpc error: code = NotFound desc = could not find container \"a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5\": container with ID starting with a0152078d2a10c2e70f5a019d6890bb905dfe6f2a77f90c3e2dfe285292d0cb5 not found: ID does not exist"
Sep 10 19:22:55.426360 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426317    2558 scope.go:117] "RemoveContainer" containerID="ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"
Sep 10 19:22:55.426527 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426510    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29"} err="failed to get container status \"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29\": rpc error: code = NotFound desc = could not find container \"ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29\": container with ID starting with ea0210d3ef71426fd5c097e4bbff57ac4e838f258a4c0c46cf10df3eb02e8e29 not found: ID does not exist"
Sep 10 19:22:55.426527 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426526    2558 scope.go:117] "RemoveContainer" containerID="a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"
Sep 10 19:22:55.426732 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426716    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe"} err="failed to get container status \"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe\": rpc error: code = NotFound desc = could not find container \"a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe\": container with ID starting with a1d4a0db65109404fffa8864e14312f882eee871a01f89b716f3df5f8f6467fe not found: ID does not exist"
Sep 10 19:22:55.426732 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426730    2558 scope.go:117] "RemoveContainer" containerID="19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"
Sep 10 19:22:55.426917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426903    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c"} err="failed to get container status \"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c\": rpc error: code = NotFound desc = could not find container \"19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c\": container with ID starting with 19ca866a90fd47838e83569392ea24a34f64ffbd016864899cd61e545a30772c not found: ID does not exist"
Sep 10 19:22:55.426958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.426918    2558 scope.go:117] "RemoveContainer" containerID="83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de"
Sep 10 19:22:55.427100 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.427085    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de"} err="failed to get container status \"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de\": rpc error: code = NotFound desc = could not find container \"83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de\": container with ID starting with 83d84fcc1a0bc4f09804f157d8b2e3932954cfe5179c29676f220843e762e8de not found: ID does not exist"
Sep 10 19:22:55.472655 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472625    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-alertmanager-main-db\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472655 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472653    2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-volume\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472662    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09b22f2f-d15a-4af5-b623-7ffe70dd7199-metrics-client-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472671    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472680    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-tls-assets\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472690    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhz4g\" (UniqueName: \"kubernetes.io/projected/09b22f2f-d15a-4af5-b623-7ffe70dd7199-kube-api-access-fhz4g\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472698    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-main-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472706    2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-cluster-tls-config\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472715    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472723    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09b22f2f-d15a-4af5-b623-7ffe70dd7199-config-out\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472731    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.472755 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.472739    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09b22f2f-d15a-4af5-b623-7ffe70dd7199-web-config\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:22:55.695726 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.695692    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:22:55.704662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.704638    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:22:55.745172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745149    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:22:55.745429 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745415    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-metric"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745431    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-metric"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745438    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="prom-label-proxy"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745444    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="prom-label-proxy"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745452    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="alertmanager"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745458    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="alertmanager"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745463    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="config-reloader"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745468    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="config-reloader"
Sep 10 19:22:55.745474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745475    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="init-config-reloader"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745481    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="init-config-reloader"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745488    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-web"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745493    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-web"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745503    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745507    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745517    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afcc8dc0-a090-4960-88b6-539924a604c3" containerName="registry"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745522    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="afcc8dc0-a090-4960-88b6-539924a604c3" containerName="registry"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745563    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="prom-label-proxy"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745571    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="afcc8dc0-a090-4960-88b6-539924a604c3" containerName="registry"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745577    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-web"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745583    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745587    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="kube-rbac-proxy-metric"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745592    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="config-reloader"
Sep 10 19:22:55.745701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.745598    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" containerName="alertmanager"
Sep 10 19:22:55.749005 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.748986    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.754311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754019    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 19:22:55.754311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754143    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 19:22:55.754311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754149    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 19:22:55.754311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754020    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 19:22:55.754586 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754441    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c79ml\""
Sep 10 19:22:55.754682 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754665    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 19:22:55.754731 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754712    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 19:22:55.754777 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754751    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 19:22:55.754777 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.754711    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 19:22:55.759357 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.759338    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 19:22:55.775164 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/839f399b-0935-4738-bffd-55db87770d61-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775273 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775191    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775273 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/839f399b-0935-4738-bffd-55db87770d61-config-out\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775394 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775394 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/839f399b-0935-4738-bffd-55db87770d61-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775394 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775394 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775771 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-web-config\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/839f399b-0935-4738-bffd-55db87770d61-tls-assets\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775860 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775894 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-config-volume\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775931 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xb2\" (UniqueName: \"kubernetes.io/projected/839f399b-0935-4738-bffd-55db87770d61-kube-api-access-92xb2\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.775931 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.775919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/839f399b-0935-4738-bffd-55db87770d61-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.776928 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.776908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:22:55.877208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-config-volume\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xb2\" (UniqueName: \"kubernetes.io/projected/839f399b-0935-4738-bffd-55db87770d61-kube-api-access-92xb2\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877479 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877219    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/839f399b-0935-4738-bffd-55db87770d61-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877479 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/839f399b-0935-4738-bffd-55db87770d61-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877479 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877479 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/839f399b-0935-4738-bffd-55db87770d61-config-out\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877479 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877479 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/839f399b-0935-4738-bffd-55db87770d61-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-web-config\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/839f399b-0935-4738-bffd-55db87770d61-tls-assets\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.877796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.877685    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/839f399b-0935-4738-bffd-55db87770d61-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.878659 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.878634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/839f399b-0935-4738-bffd-55db87770d61-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.878799 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.878774    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/839f399b-0935-4738-bffd-55db87770d61-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.880186 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.880151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/839f399b-0935-4738-bffd-55db87770d61-config-out\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.880407 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.880366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.880500 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.880452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-config-volume\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.880595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.880568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.880662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.880636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.880783 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.880768    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.881206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.881190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/839f399b-0935-4738-bffd-55db87770d61-tls-assets\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.881714 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.881699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-web-config\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.881953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.881937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/839f399b-0935-4738-bffd-55db87770d61-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:55.887703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:55.887683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xb2\" (UniqueName: \"kubernetes.io/projected/839f399b-0935-4738-bffd-55db87770d61-kube-api-access-92xb2\") pod \"alertmanager-main-0\" (UID: \"839f399b-0935-4738-bffd-55db87770d61\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:56.062942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:56.062905    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 19:22:56.347206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:56.347179    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 19:22:56.348717 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:22:56.348685    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839f399b_0935_4738_bffd_55db87770d61.slice/crio-8492ebc1ea082c8522f1b42cf756d10431d30a318eee2b675e53d84a51727932 WatchSource:0}: Error finding container 8492ebc1ea082c8522f1b42cf756d10431d30a318eee2b675e53d84a51727932: Status 404 returned error can't find the container with id 8492ebc1ea082c8522f1b42cf756d10431d30a318eee2b675e53d84a51727932
Sep 10 19:22:56.381933 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:56.381906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerStarted","Data":"8492ebc1ea082c8522f1b42cf756d10431d30a318eee2b675e53d84a51727932"}
Sep 10 19:22:57.386969 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:57.386884    2558 generic.go:356] "Generic (PLEG): container finished" podID="839f399b-0935-4738-bffd-55db87770d61" containerID="7490e6ce2d2eb2a3534aee4f3ca2e0ddfb6c98a8d940bd8deb48e061dfe029ce" exitCode=0
Sep 10 19:22:57.387314 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:57.386975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerDied","Data":"7490e6ce2d2eb2a3534aee4f3ca2e0ddfb6c98a8d940bd8deb48e061dfe029ce"}
Sep 10 19:22:57.655756 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:57.655727    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09b22f2f-d15a-4af5-b623-7ffe70dd7199" path="/var/lib/kubelet/pods/09b22f2f-d15a-4af5-b623-7ffe70dd7199/volumes"
Sep 10 19:22:58.090621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.090586    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-677bf9775c-psfkp"]
Sep 10 19:22:58.092678 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.092657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.102745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.102721    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 19:22:58.102878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.102779    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 19:22:58.102878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.102851    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 19:22:58.103416 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.103399    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 19:22:58.103476 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.103460    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 19:22:58.105611 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.105586    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2cccq\""
Sep 10 19:22:58.112773 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.112747    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 19:22:58.122891 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.122872    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677bf9775c-psfkp"]
Sep 10 19:22:58.194661 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-telemeter-client-tls\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.194803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-federate-client-tls\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.194803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.194803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-serving-certs-ca-bundle\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.194803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-secret-telemeter-client\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.194937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.194937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t262h\" (UniqueName: \"kubernetes.io/projected/beb44d42-f042-4a98-a4b5-60688d2430e9-kube-api-access-t262h\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.194937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.194901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-metrics-client-ca\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.295986 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.295948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-serving-certs-ca-bundle\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.295986 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.295983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-secret-telemeter-client\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.296172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296027    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.296172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t262h\" (UniqueName: \"kubernetes.io/projected/beb44d42-f042-4a98-a4b5-60688d2430e9-kube-api-access-t262h\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.296172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-metrics-client-ca\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.296172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-telemeter-client-tls\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.296172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-federate-client-tls\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.296410 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.296835 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-serving-certs-ca-bundle\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.297001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-metrics-client-ca\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.297001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.296941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beb44d42-f042-4a98-a4b5-60688d2430e9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.298749 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.298712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-telemeter-client-tls\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.298837 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.298766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.299036 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.299017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-secret-telemeter-client\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.299179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.299159    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beb44d42-f042-4a98-a4b5-60688d2430e9-federate-client-tls\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.318265 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.318236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t262h\" (UniqueName: \"kubernetes.io/projected/beb44d42-f042-4a98-a4b5-60688d2430e9-kube-api-access-t262h\") pod \"telemeter-client-677bf9775c-psfkp\" (UID: \"beb44d42-f042-4a98-a4b5-60688d2430e9\") " pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.393976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.393886    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerStarted","Data":"8c9991c72d434728e285006e77d247f9ed4c575163213ab160566b55bdcad9bc"}
Sep 10 19:22:58.393976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.393952    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerStarted","Data":"074a8d48841b3472ba6527dc5a9e6857c7c837e3939f92496469bed81db73d63"}
Sep 10 19:22:58.394406 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.393979    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerStarted","Data":"736e019047660309db12e126dfc52acdf27a49296aab247af5b92c70e60aed58"}
Sep 10 19:22:58.394406 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.394002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerStarted","Data":"82b8234173af1cdbb6a00da95b7413cc09417becca63acc91edcaeb16b38c2f5"}
Sep 10 19:22:58.394406 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.394031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerStarted","Data":"df3dab2c5687db4fb7f89ef09ee10083e33a9bc02ada8401f51924de247608c2"}
Sep 10 19:22:58.394406 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.394054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"839f399b-0935-4738-bffd-55db87770d61","Type":"ContainerStarted","Data":"b051802116d9535b8d85f98314fef95cfd4467c70cdf783ec7748d7452f893b9"}
Sep 10 19:22:58.411409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.411366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp"
Sep 10 19:22:58.484775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.484726    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.465259897 podStartE2EDuration="3.484706197s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.4463ms" isStatefulPod=false podCreationTimestamp="2026-09-10 19:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:22:58.476274635 +0000 UTC m=+167.292884216" watchObservedRunningTime="2026-09-10 19:22:58.484706197 +0000 UTC m=+167.301315796"
Sep 10 19:22:58.717629 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:58.717447    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677bf9775c-psfkp"]
Sep 10 19:22:58.720210 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:22:58.720184    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb44d42_f042_4a98_a4b5_60688d2430e9.slice/crio-086b8c22b977152f4c8ac62e0fa2e5e65a9e15acf00468702e16b4b7a8812832 WatchSource:0}: Error finding container 086b8c22b977152f4c8ac62e0fa2e5e65a9e15acf00468702e16b4b7a8812832: Status 404 returned error can't find the container with id 086b8c22b977152f4c8ac62e0fa2e5e65a9e15acf00468702e16b4b7a8812832
Sep 10 19:22:59.399633 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:22:59.399599    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp" event={"ID":"beb44d42-f042-4a98-a4b5-60688d2430e9","Type":"ContainerStarted","Data":"086b8c22b977152f4c8ac62e0fa2e5e65a9e15acf00468702e16b4b7a8812832"}
Sep 10 19:23:01.408907 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:23:01.408873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp" event={"ID":"beb44d42-f042-4a98-a4b5-60688d2430e9","Type":"ContainerStarted","Data":"678a2b3975a65e5140f77e37ac68051bc06da3f920dd23d2445bbc1da9efb367"}
Sep 10 19:23:01.409282 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:23:01.408953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp" event={"ID":"beb44d42-f042-4a98-a4b5-60688d2430e9","Type":"ContainerStarted","Data":"45feeef4e7f17a30ed645afdb7f8b31871e4caf2aebff43e2ff9241698f2e572"}
Sep 10 19:23:01.409282 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:23:01.408973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp" event={"ID":"beb44d42-f042-4a98-a4b5-60688d2430e9","Type":"ContainerStarted","Data":"d7dd1ddb3928a934674f4f86b5236d187a5254f603bd6f6434ee09b14ce9ef8e"}
Sep 10 19:23:01.457455 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:23:01.457396    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-677bf9775c-psfkp" podStartSLOduration=1.4256245810000001 podStartE2EDuration="3.457360554s" totalImagesPullingTime="2.031735973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:23:01.453898029 +0000 UTC m=+170.270507596" watchObservedRunningTime="2026-09-10 19:23:01.457360554 +0000 UTC m=+170.273970122"
Sep 10 19:25:11.561867 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:25:11.561842    2558 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 19:26:13.054329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.054243    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"]
Sep 10 19:26:13.057465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.057442    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.059899 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.059880    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 19:26:13.060609 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.060592    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s7mzv\""
Sep 10 19:26:13.060729 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.060611    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 19:26:13.068278 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.068249    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"]
Sep 10 19:26:13.101633 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.101604    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9g8\" (UniqueName: \"kubernetes.io/projected/22ef6d87-291d-4df0-800e-c16febb7cc1d-kube-api-access-9t9g8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.101790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.101652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.101790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.101716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.202612 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.202583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.202716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.202645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9g8\" (UniqueName: \"kubernetes.io/projected/22ef6d87-291d-4df0-800e-c16febb7cc1d-kube-api-access-9t9g8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.202716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.202676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.202984 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.202964    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.203021 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.203004    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.211671 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.211640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9g8\" (UniqueName: \"kubernetes.io/projected/22ef6d87-291d-4df0-800e-c16febb7cc1d-kube-api-access-9t9g8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.366608 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.366518    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:13.637319 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.637282    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"]
Sep 10 19:26:13.639858 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:26:13.639832    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ef6d87_291d_4df0_800e_c16febb7cc1d.slice/crio-9df26c0ffa689fad3abde4ca7b54e52bf3813cb6fa43fe44b76a4da9c60725b8 WatchSource:0}: Error finding container 9df26c0ffa689fad3abde4ca7b54e52bf3813cb6fa43fe44b76a4da9c60725b8: Status 404 returned error can't find the container with id 9df26c0ffa689fad3abde4ca7b54e52bf3813cb6fa43fe44b76a4da9c60725b8
Sep 10 19:26:13.641900 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:13.641879    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:26:14.099210 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:14.099171    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr" event={"ID":"22ef6d87-291d-4df0-800e-c16febb7cc1d","Type":"ContainerStarted","Data":"9df26c0ffa689fad3abde4ca7b54e52bf3813cb6fa43fe44b76a4da9c60725b8"}
Sep 10 19:26:21.126575 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:21.126542    2558 generic.go:356] "Generic (PLEG): container finished" podID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerID="83e5c7139f456112f5b3fdf89fe7e4ee56ac901ecfe97f2f6e2eee62477831bc" exitCode=0
Sep 10 19:26:21.126920 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:21.126589    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr" event={"ID":"22ef6d87-291d-4df0-800e-c16febb7cc1d","Type":"ContainerDied","Data":"83e5c7139f456112f5b3fdf89fe7e4ee56ac901ecfe97f2f6e2eee62477831bc"}
Sep 10 19:26:24.142995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:24.142953    2558 generic.go:356] "Generic (PLEG): container finished" podID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerID="76935dfe5ef362217d8bf5829029bf95cadb524f86290dfc505c6cae43d125ea" exitCode=0
Sep 10 19:26:24.143395 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:24.143030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr" event={"ID":"22ef6d87-291d-4df0-800e-c16febb7cc1d","Type":"ContainerDied","Data":"76935dfe5ef362217d8bf5829029bf95cadb524f86290dfc505c6cae43d125ea"}
Sep 10 19:26:32.178782 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:32.178692    2558 generic.go:356] "Generic (PLEG): container finished" podID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerID="dc896879aa83afcb1e40dee349fd4cb9dc66b747ada30ae644c793a4cfe8f7e1" exitCode=0
Sep 10 19:26:32.178782 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:32.178747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr" event={"ID":"22ef6d87-291d-4df0-800e-c16febb7cc1d","Type":"ContainerDied","Data":"dc896879aa83afcb1e40dee349fd4cb9dc66b747ada30ae644c793a4cfe8f7e1"}
Sep 10 19:26:33.302405 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.302364    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:33.385368 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.385333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-bundle\") pod \"22ef6d87-291d-4df0-800e-c16febb7cc1d\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") "
Sep 10 19:26:33.385368 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.385391    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-util\") pod \"22ef6d87-291d-4df0-800e-c16febb7cc1d\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") "
Sep 10 19:26:33.385571 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.385422    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t9g8\" (UniqueName: \"kubernetes.io/projected/22ef6d87-291d-4df0-800e-c16febb7cc1d-kube-api-access-9t9g8\") pod \"22ef6d87-291d-4df0-800e-c16febb7cc1d\" (UID: \"22ef6d87-291d-4df0-800e-c16febb7cc1d\") "
Sep 10 19:26:33.385990 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.385951    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-bundle" (OuterVolumeSpecName: "bundle") pod "22ef6d87-291d-4df0-800e-c16febb7cc1d" (UID: "22ef6d87-291d-4df0-800e-c16febb7cc1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:26:33.387760 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.387729    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ef6d87-291d-4df0-800e-c16febb7cc1d-kube-api-access-9t9g8" (OuterVolumeSpecName: "kube-api-access-9t9g8") pod "22ef6d87-291d-4df0-800e-c16febb7cc1d" (UID: "22ef6d87-291d-4df0-800e-c16febb7cc1d"). InnerVolumeSpecName "kube-api-access-9t9g8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:26:33.389320 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.389289    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-util" (OuterVolumeSpecName: "util") pod "22ef6d87-291d-4df0-800e-c16febb7cc1d" (UID: "22ef6d87-291d-4df0-800e-c16febb7cc1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:26:33.486290 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.486259    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:26:33.486290 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.486287    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/22ef6d87-291d-4df0-800e-c16febb7cc1d-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:26:33.486513 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:33.486299    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t9g8\" (UniqueName: \"kubernetes.io/projected/22ef6d87-291d-4df0-800e-c16febb7cc1d-kube-api-access-9t9g8\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:26:34.188212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:34.188182    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr"
Sep 10 19:26:34.188414 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:34.188175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z6whr" event={"ID":"22ef6d87-291d-4df0-800e-c16febb7cc1d","Type":"ContainerDied","Data":"9df26c0ffa689fad3abde4ca7b54e52bf3813cb6fa43fe44b76a4da9c60725b8"}
Sep 10 19:26:34.188414 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:34.188306    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9df26c0ffa689fad3abde4ca7b54e52bf3813cb6fa43fe44b76a4da9c60725b8"
Sep 10 19:26:41.513892 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.513855    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"]
Sep 10 19:26:41.514474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.514257    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerName="pull"
Sep 10 19:26:41.514474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.514276    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerName="pull"
Sep 10 19:26:41.514474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.514289    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerName="util"
Sep 10 19:26:41.514474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.514297    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerName="util"
Sep 10 19:26:41.514474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.514306    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerName="extract"
Sep 10 19:26:41.514474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.514316    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerName="extract"
Sep 10 19:26:41.514474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.514428    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="22ef6d87-291d-4df0-800e-c16febb7cc1d" containerName="extract"
Sep 10 19:26:41.516341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.516321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:41.519057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.519034    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 19:26:41.519258 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.519244    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 19:26:41.519725 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.519707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w8ckf\""
Sep 10 19:26:41.532245 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.532219    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"]
Sep 10 19:26:41.651724 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.651684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqxh\" (UniqueName: \"kubernetes.io/projected/0264808e-5146-425a-8cbf-7bf0d11ef947-kube-api-access-rcqxh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kdbk\" (UID: \"0264808e-5146-425a-8cbf-7bf0d11ef947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:41.651893 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.651818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0264808e-5146-425a-8cbf-7bf0d11ef947-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kdbk\" (UID: \"0264808e-5146-425a-8cbf-7bf0d11ef947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:41.753143 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.753111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0264808e-5146-425a-8cbf-7bf0d11ef947-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kdbk\" (UID: \"0264808e-5146-425a-8cbf-7bf0d11ef947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:41.753303 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.753166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqxh\" (UniqueName: \"kubernetes.io/projected/0264808e-5146-425a-8cbf-7bf0d11ef947-kube-api-access-rcqxh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kdbk\" (UID: \"0264808e-5146-425a-8cbf-7bf0d11ef947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:41.753508 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.753476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0264808e-5146-425a-8cbf-7bf0d11ef947-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kdbk\" (UID: \"0264808e-5146-425a-8cbf-7bf0d11ef947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:41.765502 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.765454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqxh\" (UniqueName: \"kubernetes.io/projected/0264808e-5146-425a-8cbf-7bf0d11ef947-kube-api-access-rcqxh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kdbk\" (UID: \"0264808e-5146-425a-8cbf-7bf0d11ef947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:41.825262 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:41.825234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"
Sep 10 19:26:42.097491 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:42.097468    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk"]
Sep 10 19:26:42.099827 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:26:42.099802    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0264808e_5146_425a_8cbf_7bf0d11ef947.slice/crio-567573180a15a6f8b68a1fd532c5933dcce93480eff1cd60e9773c6d003fadee WatchSource:0}: Error finding container 567573180a15a6f8b68a1fd532c5933dcce93480eff1cd60e9773c6d003fadee: Status 404 returned error can't find the container with id 567573180a15a6f8b68a1fd532c5933dcce93480eff1cd60e9773c6d003fadee
Sep 10 19:26:42.220785 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:42.220753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk" event={"ID":"0264808e-5146-425a-8cbf-7bf0d11ef947","Type":"ContainerStarted","Data":"567573180a15a6f8b68a1fd532c5933dcce93480eff1cd60e9773c6d003fadee"}
Sep 10 19:26:44.233519 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:44.233477    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk" event={"ID":"0264808e-5146-425a-8cbf-7bf0d11ef947","Type":"ContainerStarted","Data":"15bfb78433d4ea4be139368fef363a92e102d148159fb7bac63ae338e7560678"}
Sep 10 19:26:45.526546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.526487    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kdbk" podStartSLOduration=2.906129815 podStartE2EDuration="4.526449125s" totalImagesPullingTime="1.62031931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:26:44.342034084 +0000 UTC m=+393.158643680" watchObservedRunningTime="2026-09-10 19:26:45.526449125 +0000 UTC m=+394.343058693"
Sep 10 19:26:45.526912 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.526617    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"]
Sep 10 19:26:45.528896 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.528877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.532934 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.532911    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 19:26:45.533129 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.533115    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 19:26:45.533221 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.533170    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s7mzv\""
Sep 10 19:26:45.545301 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.545276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"]
Sep 10 19:26:45.686192 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.686159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.686358 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.686203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h9sq\" (UniqueName: \"kubernetes.io/projected/6989dd6f-de65-4776-8db5-bc643eba5b1b-kube-api-access-8h9sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.686358 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.686224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.787644 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.787540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.787644 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.787603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h9sq\" (UniqueName: \"kubernetes.io/projected/6989dd6f-de65-4776-8db5-bc643eba5b1b-kube-api-access-8h9sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.787644 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.787624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.787994 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.787972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.788033 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.787993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.796745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.796720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h9sq\" (UniqueName: \"kubernetes.io/projected/6989dd6f-de65-4776-8db5-bc643eba5b1b-kube-api-access-8h9sq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:45.837559 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:45.837527    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:46.112081 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:46.112060    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"]
Sep 10 19:26:46.114460 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:26:46.114430    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6989dd6f_de65_4776_8db5_bc643eba5b1b.slice/crio-502a90269cb96da8e99fb64f2990f7e05ff2de438651b28d7bea9f8322928644 WatchSource:0}: Error finding container 502a90269cb96da8e99fb64f2990f7e05ff2de438651b28d7bea9f8322928644: Status 404 returned error can't find the container with id 502a90269cb96da8e99fb64f2990f7e05ff2de438651b28d7bea9f8322928644
Sep 10 19:26:46.242560 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:46.242522    2558 generic.go:356] "Generic (PLEG): container finished" podID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerID="fc542f6620836964cccaf39d72f3f09febd8100ae5201556e87912aae6b8ed00" exitCode=0
Sep 10 19:26:46.242710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:46.242577    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl" event={"ID":"6989dd6f-de65-4776-8db5-bc643eba5b1b","Type":"ContainerDied","Data":"fc542f6620836964cccaf39d72f3f09febd8100ae5201556e87912aae6b8ed00"}
Sep 10 19:26:46.242710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:46.242614    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl" event={"ID":"6989dd6f-de65-4776-8db5-bc643eba5b1b","Type":"ContainerStarted","Data":"502a90269cb96da8e99fb64f2990f7e05ff2de438651b28d7bea9f8322928644"}
Sep 10 19:26:49.258162 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:49.258127    2558 generic.go:356] "Generic (PLEG): container finished" podID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerID="a7f1cf69edd57338944c10d566efe8c6fbc466ee3284a7614ebae3804771949b" exitCode=0
Sep 10 19:26:49.258544 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:49.258224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl" event={"ID":"6989dd6f-de65-4776-8db5-bc643eba5b1b","Type":"ContainerDied","Data":"a7f1cf69edd57338944c10d566efe8c6fbc466ee3284a7614ebae3804771949b"}
Sep 10 19:26:50.265308 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:50.265273    2558 generic.go:356] "Generic (PLEG): container finished" podID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerID="031cf8b6d9b00d580ef6b7db0b4fbb4eb8748644d833aa9854886bdd9677e65a" exitCode=0
Sep 10 19:26:50.265693 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:50.265346    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl" event={"ID":"6989dd6f-de65-4776-8db5-bc643eba5b1b","Type":"ContainerDied","Data":"031cf8b6d9b00d580ef6b7db0b4fbb4eb8748644d833aa9854886bdd9677e65a"}
Sep 10 19:26:51.396104 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.396079    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:51.433794 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.433767    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-bundle\") pod \"6989dd6f-de65-4776-8db5-bc643eba5b1b\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") "
Sep 10 19:26:51.433948 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.433844    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-util\") pod \"6989dd6f-de65-4776-8db5-bc643eba5b1b\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") "
Sep 10 19:26:51.433948 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.433878    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h9sq\" (UniqueName: \"kubernetes.io/projected/6989dd6f-de65-4776-8db5-bc643eba5b1b-kube-api-access-8h9sq\") pod \"6989dd6f-de65-4776-8db5-bc643eba5b1b\" (UID: \"6989dd6f-de65-4776-8db5-bc643eba5b1b\") "
Sep 10 19:26:51.434203 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.434176    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-bundle" (OuterVolumeSpecName: "bundle") pod "6989dd6f-de65-4776-8db5-bc643eba5b1b" (UID: "6989dd6f-de65-4776-8db5-bc643eba5b1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:26:51.435899 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.435872    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6989dd6f-de65-4776-8db5-bc643eba5b1b-kube-api-access-8h9sq" (OuterVolumeSpecName: "kube-api-access-8h9sq") pod "6989dd6f-de65-4776-8db5-bc643eba5b1b" (UID: "6989dd6f-de65-4776-8db5-bc643eba5b1b"). InnerVolumeSpecName "kube-api-access-8h9sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:26:51.439231 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.439208    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-util" (OuterVolumeSpecName: "util") pod "6989dd6f-de65-4776-8db5-bc643eba5b1b" (UID: "6989dd6f-de65-4776-8db5-bc643eba5b1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:26:51.534839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.534750    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h9sq\" (UniqueName: \"kubernetes.io/projected/6989dd6f-de65-4776-8db5-bc643eba5b1b-kube-api-access-8h9sq\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:26:51.534839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.534789    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:26:51.534839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:51.534800    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6989dd6f-de65-4776-8db5-bc643eba5b1b-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:26:52.277071 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.277045    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl"
Sep 10 19:26:52.277071 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.277057    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft68cl" event={"ID":"6989dd6f-de65-4776-8db5-bc643eba5b1b","Type":"ContainerDied","Data":"502a90269cb96da8e99fb64f2990f7e05ff2de438651b28d7bea9f8322928644"}
Sep 10 19:26:52.277321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.277095    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="502a90269cb96da8e99fb64f2990f7e05ff2de438651b28d7bea9f8322928644"
Sep 10 19:26:52.700797 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.700763    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"]
Sep 10 19:26:52.701158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.701049    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerName="util"
Sep 10 19:26:52.701158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.701061    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerName="util"
Sep 10 19:26:52.701158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.701070    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerName="extract"
Sep 10 19:26:52.701158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.701077    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerName="extract"
Sep 10 19:26:52.701158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.701091    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerName="pull"
Sep 10 19:26:52.701158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.701097    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerName="pull"
Sep 10 19:26:52.701396 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.701172    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6989dd6f-de65-4776-8db5-bc643eba5b1b" containerName="extract"
Sep 10 19:26:52.702971 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.702951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:52.706272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.706251    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7zgrn\""
Sep 10 19:26:52.706905 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.706889    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 19:26:52.707520 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.707503    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 19:26:52.743022 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.742987    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"]
Sep 10 19:26:52.748643 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.744854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f155f135-80ef-4587-bec9-14de35324621-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9nqlj\" (UID: \"f155f135-80ef-4587-bec9-14de35324621\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:52.748643 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.744919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7kww\" (UniqueName: \"kubernetes.io/projected/f155f135-80ef-4587-bec9-14de35324621-kube-api-access-h7kww\") pod \"cert-manager-cainjector-559cdd8c87-9nqlj\" (UID: \"f155f135-80ef-4587-bec9-14de35324621\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:52.845862 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.845827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f155f135-80ef-4587-bec9-14de35324621-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9nqlj\" (UID: \"f155f135-80ef-4587-bec9-14de35324621\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:52.845862 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.845869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7kww\" (UniqueName: \"kubernetes.io/projected/f155f135-80ef-4587-bec9-14de35324621-kube-api-access-h7kww\") pod \"cert-manager-cainjector-559cdd8c87-9nqlj\" (UID: \"f155f135-80ef-4587-bec9-14de35324621\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:52.855902 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.855861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f155f135-80ef-4587-bec9-14de35324621-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9nqlj\" (UID: \"f155f135-80ef-4587-bec9-14de35324621\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:52.856102 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:52.856081    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7kww\" (UniqueName: \"kubernetes.io/projected/f155f135-80ef-4587-bec9-14de35324621-kube-api-access-h7kww\") pod \"cert-manager-cainjector-559cdd8c87-9nqlj\" (UID: \"f155f135-80ef-4587-bec9-14de35324621\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:53.014538 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:53.014456    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"
Sep 10 19:26:53.283383 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:53.283348    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj"]
Sep 10 19:26:53.285860 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:26:53.285834    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf155f135_80ef_4587_bec9_14de35324621.slice/crio-68692fd5b4e7ea56ad00136efaa0884e879c51a400a9cee2eb23efaec55bfa26 WatchSource:0}: Error finding container 68692fd5b4e7ea56ad00136efaa0884e879c51a400a9cee2eb23efaec55bfa26: Status 404 returned error can't find the container with id 68692fd5b4e7ea56ad00136efaa0884e879c51a400a9cee2eb23efaec55bfa26
Sep 10 19:26:54.287570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:54.287485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj" event={"ID":"f155f135-80ef-4587-bec9-14de35324621","Type":"ContainerStarted","Data":"68692fd5b4e7ea56ad00136efaa0884e879c51a400a9cee2eb23efaec55bfa26"}
Sep 10 19:26:56.299493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:56.299457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj" event={"ID":"f155f135-80ef-4587-bec9-14de35324621","Type":"ContainerStarted","Data":"26ca6e32871c15de9d765adc5b5e7841b52e8f7d0b69b5f1beca6b4b5eed1f0d"}
Sep 10 19:26:58.649255 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.649201    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9nqlj" podStartSLOduration=4.131832052 podStartE2EDuration="6.649183606s" totalImagesPullingTime="2.517351554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:26:56.315213027 +0000 UTC m=+405.131822596" watchObservedRunningTime="2026-09-10 19:26:58.649183606 +0000 UTC m=+407.465793174"
Sep 10 19:26:58.649729 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.649405    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vcv82"]
Sep 10 19:26:58.652728 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.652709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:58.659037 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.658761    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-72ppb\""
Sep 10 19:26:58.669594 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.669569    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vcv82"]
Sep 10 19:26:58.693240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.693207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b482e16e-4a3c-4bad-b8a9-45952f272997-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vcv82\" (UID: \"b482e16e-4a3c-4bad-b8a9-45952f272997\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:58.693421 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.693265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2xtl\" (UniqueName: \"kubernetes.io/projected/b482e16e-4a3c-4bad-b8a9-45952f272997-kube-api-access-t2xtl\") pod \"cert-manager-webhook-6486ffd997-vcv82\" (UID: \"b482e16e-4a3c-4bad-b8a9-45952f272997\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:58.794586 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.794545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b482e16e-4a3c-4bad-b8a9-45952f272997-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vcv82\" (UID: \"b482e16e-4a3c-4bad-b8a9-45952f272997\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:58.794760 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.794614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2xtl\" (UniqueName: \"kubernetes.io/projected/b482e16e-4a3c-4bad-b8a9-45952f272997-kube-api-access-t2xtl\") pod \"cert-manager-webhook-6486ffd997-vcv82\" (UID: \"b482e16e-4a3c-4bad-b8a9-45952f272997\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:58.807239 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.807201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b482e16e-4a3c-4bad-b8a9-45952f272997-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vcv82\" (UID: \"b482e16e-4a3c-4bad-b8a9-45952f272997\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:58.810970 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.810939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2xtl\" (UniqueName: \"kubernetes.io/projected/b482e16e-4a3c-4bad-b8a9-45952f272997-kube-api-access-t2xtl\") pod \"cert-manager-webhook-6486ffd997-vcv82\" (UID: \"b482e16e-4a3c-4bad-b8a9-45952f272997\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:58.961640 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:58.961611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:59.233194 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:59.233123    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vcv82"]
Sep 10 19:26:59.235443 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:26:59.235408    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb482e16e_4a3c_4bad_b8a9_45952f272997.slice/crio-97e21572b00f242cbca4154f5c4c75d8292a05c0662d2329770a732685561fea WatchSource:0}: Error finding container 97e21572b00f242cbca4154f5c4c75d8292a05c0662d2329770a732685561fea: Status 404 returned error can't find the container with id 97e21572b00f242cbca4154f5c4c75d8292a05c0662d2329770a732685561fea
Sep 10 19:26:59.313010 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:59.312959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82" event={"ID":"b482e16e-4a3c-4bad-b8a9-45952f272997","Type":"ContainerStarted","Data":"f9fc7894af9c2c652ccec9640957d40d3c970c38195a96ccb2a43a46fecef9e3"}
Sep 10 19:26:59.313141 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:59.313023    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:26:59.313141 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:59.313039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82" event={"ID":"b482e16e-4a3c-4bad-b8a9-45952f272997","Type":"ContainerStarted","Data":"97e21572b00f242cbca4154f5c4c75d8292a05c0662d2329770a732685561fea"}
Sep 10 19:26:59.332608 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:26:59.332401    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82" podStartSLOduration=1.332367613 podStartE2EDuration="1.332367613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:26:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:26:59.331726984 +0000 UTC m=+408.148336553" watchObservedRunningTime="2026-09-10 19:26:59.332367613 +0000 UTC m=+408.148977181"
Sep 10 19:27:05.321756 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.321721    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vcv82"
Sep 10 19:27:05.505945 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.505917    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"]
Sep 10 19:27:05.531960 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.531933    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"]
Sep 10 19:27:05.532103 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.532037    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.535610 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.535585    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 19:27:05.535767 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.535585    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 19:27:05.535767 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.535615    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s7mzv\""
Sep 10 19:27:05.650608 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.650530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.650608 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.650573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.650840 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.650731    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf8nf\" (UniqueName: \"kubernetes.io/projected/b6b6de94-fe52-4231-9f19-126e93b8b27b-kube-api-access-qf8nf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.751808 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.751775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf8nf\" (UniqueName: \"kubernetes.io/projected/b6b6de94-fe52-4231-9f19-126e93b8b27b-kube-api-access-qf8nf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.751808 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.751821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.752029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.751845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.752173 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.752152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.752210 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.752199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.771146 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.771109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf8nf\" (UniqueName: \"kubernetes.io/projected/b6b6de94-fe52-4231-9f19-126e93b8b27b-kube-api-access-qf8nf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:05.841703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:05.841664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:06.128878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:06.128854    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"]
Sep 10 19:27:06.131340 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:27:06.131317    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b6de94_fe52_4231_9f19_126e93b8b27b.slice/crio-2c5f6659e669aa30ed3f70ca4f89057321aaf7db903c688a4a288dc2f1e2f231 WatchSource:0}: Error finding container 2c5f6659e669aa30ed3f70ca4f89057321aaf7db903c688a4a288dc2f1e2f231: Status 404 returned error can't find the container with id 2c5f6659e669aa30ed3f70ca4f89057321aaf7db903c688a4a288dc2f1e2f231
Sep 10 19:27:06.344773 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:06.344739    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerID="5cf8e0dfab997511d6865958a44f821e0713a11cc318080511492148f5d1e29b" exitCode=0
Sep 10 19:27:06.345120 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:06.344806    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg" event={"ID":"b6b6de94-fe52-4231-9f19-126e93b8b27b","Type":"ContainerDied","Data":"5cf8e0dfab997511d6865958a44f821e0713a11cc318080511492148f5d1e29b"}
Sep 10 19:27:06.345120 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:06.344844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg" event={"ID":"b6b6de94-fe52-4231-9f19-126e93b8b27b","Type":"ContainerStarted","Data":"2c5f6659e669aa30ed3f70ca4f89057321aaf7db903c688a4a288dc2f1e2f231"}
Sep 10 19:27:07.351429 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:07.351387    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg" event={"ID":"b6b6de94-fe52-4231-9f19-126e93b8b27b","Type":"ContainerDied","Data":"879dc5deba89e5a683941b4b46452c70b8e06e8f3aab99a38e342ab97f754fe8"}
Sep 10 19:27:07.351798 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:07.351703    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerID="879dc5deba89e5a683941b4b46452c70b8e06e8f3aab99a38e342ab97f754fe8" exitCode=0
Sep 10 19:27:08.357564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:08.357529    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerID="6da81a33b1b0daf4b077f911da3014b3f21bcbc9a099283e5bd0c55269ac8f36" exitCode=0
Sep 10 19:27:08.357979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:08.357613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg" event={"ID":"b6b6de94-fe52-4231-9f19-126e93b8b27b","Type":"ContainerDied","Data":"6da81a33b1b0daf4b077f911da3014b3f21bcbc9a099283e5bd0c55269ac8f36"}
Sep 10 19:27:09.482447 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.482425    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:09.584419 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.584389    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-util\") pod \"b6b6de94-fe52-4231-9f19-126e93b8b27b\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") "
Sep 10 19:27:09.584576 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.584432    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf8nf\" (UniqueName: \"kubernetes.io/projected/b6b6de94-fe52-4231-9f19-126e93b8b27b-kube-api-access-qf8nf\") pod \"b6b6de94-fe52-4231-9f19-126e93b8b27b\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") "
Sep 10 19:27:09.584576 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.584516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-bundle\") pod \"b6b6de94-fe52-4231-9f19-126e93b8b27b\" (UID: \"b6b6de94-fe52-4231-9f19-126e93b8b27b\") "
Sep 10 19:27:09.585194 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.585168    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-bundle" (OuterVolumeSpecName: "bundle") pod "b6b6de94-fe52-4231-9f19-126e93b8b27b" (UID: "b6b6de94-fe52-4231-9f19-126e93b8b27b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:27:09.586497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.586475    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b6de94-fe52-4231-9f19-126e93b8b27b-kube-api-access-qf8nf" (OuterVolumeSpecName: "kube-api-access-qf8nf") pod "b6b6de94-fe52-4231-9f19-126e93b8b27b" (UID: "b6b6de94-fe52-4231-9f19-126e93b8b27b"). InnerVolumeSpecName "kube-api-access-qf8nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:27:09.589915 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.589891    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-util" (OuterVolumeSpecName: "util") pod "b6b6de94-fe52-4231-9f19-126e93b8b27b" (UID: "b6b6de94-fe52-4231-9f19-126e93b8b27b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:27:09.685968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.685939    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf8nf\" (UniqueName: \"kubernetes.io/projected/b6b6de94-fe52-4231-9f19-126e93b8b27b-kube-api-access-qf8nf\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:27:09.685968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.685964    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:27:09.686110 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:09.685974    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b6de94-fe52-4231-9f19-126e93b8b27b-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:27:10.367390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:10.367352    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg"
Sep 10 19:27:10.367554 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:10.367397    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn29xg" event={"ID":"b6b6de94-fe52-4231-9f19-126e93b8b27b","Type":"ContainerDied","Data":"2c5f6659e669aa30ed3f70ca4f89057321aaf7db903c688a4a288dc2f1e2f231"}
Sep 10 19:27:10.367554 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:10.367436    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c5f6659e669aa30ed3f70ca4f89057321aaf7db903c688a4a288dc2f1e2f231"
Sep 10 19:27:22.514912 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.514876    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"]
Sep 10 19:27:22.515259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.515168    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerName="util"
Sep 10 19:27:22.515259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.515179    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerName="util"
Sep 10 19:27:22.515259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.515186    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerName="extract"
Sep 10 19:27:22.515259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.515192    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerName="extract"
Sep 10 19:27:22.515259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.515201    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerName="pull"
Sep 10 19:27:22.515259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.515206    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerName="pull"
Sep 10 19:27:22.515259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.515255    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b6de94-fe52-4231-9f19-126e93b8b27b" containerName="extract"
Sep 10 19:27:22.522384 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.522355    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.527515 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.527492    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 19:27:22.527717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.527695    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 19:27:22.527792 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.527724    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q6dtv\""
Sep 10 19:27:22.527876 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.527860    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 19:27:22.528190 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.528174    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 19:27:22.553253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.553225    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"]
Sep 10 19:27:22.597828 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.597792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47bf8d5-79a6-4552-887e-793d64a1ba99-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.597828 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.597834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a47bf8d5-79a6-4552-887e-793d64a1ba99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.598027 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.597881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a47bf8d5-79a6-4552-887e-793d64a1ba99-tmp\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.598027 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.597916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htbxn\" (UniqueName: \"kubernetes.io/projected/a47bf8d5-79a6-4552-887e-793d64a1ba99-kube-api-access-htbxn\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.598027 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.598005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a47bf8d5-79a6-4552-887e-793d64a1ba99-manifests\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.698789 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.698752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htbxn\" (UniqueName: \"kubernetes.io/projected/a47bf8d5-79a6-4552-887e-793d64a1ba99-kube-api-access-htbxn\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.698966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.698813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a47bf8d5-79a6-4552-887e-793d64a1ba99-manifests\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.698966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.698838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47bf8d5-79a6-4552-887e-793d64a1ba99-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.698966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.698861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a47bf8d5-79a6-4552-887e-793d64a1ba99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.698966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.698902    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a47bf8d5-79a6-4552-887e-793d64a1ba99-tmp\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.699210 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.699186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a47bf8d5-79a6-4552-887e-793d64a1ba99-manifests\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.701023 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.700993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a47bf8d5-79a6-4552-887e-793d64a1ba99-tmp\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.701205 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.701185    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47bf8d5-79a6-4552-887e-793d64a1ba99-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.701332 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.701314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a47bf8d5-79a6-4552-887e-793d64a1ba99-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.719686 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.719658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htbxn\" (UniqueName: \"kubernetes.io/projected/a47bf8d5-79a6-4552-887e-793d64a1ba99-kube-api-access-htbxn\") pod \"opendatahub-operator-controller-manager-5ddcddd787-cnlmb\" (UID: \"a47bf8d5-79a6-4552-887e-793d64a1ba99\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:22.832320 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:22.832229    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:23.110743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:23.110719    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"]
Sep 10 19:27:23.113180 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:27:23.113155    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47bf8d5_79a6_4552_887e_793d64a1ba99.slice/crio-9c00ab19f2bfdaa70a835fa309a2842d9a611ba37b136af1332312d252aea800 WatchSource:0}: Error finding container 9c00ab19f2bfdaa70a835fa309a2842d9a611ba37b136af1332312d252aea800: Status 404 returned error can't find the container with id 9c00ab19f2bfdaa70a835fa309a2842d9a611ba37b136af1332312d252aea800
Sep 10 19:27:23.423420 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:23.423316    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb" event={"ID":"a47bf8d5-79a6-4552-887e-793d64a1ba99","Type":"ContainerStarted","Data":"9c00ab19f2bfdaa70a835fa309a2842d9a611ba37b136af1332312d252aea800"}
Sep 10 19:27:26.440413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:26.440367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb" event={"ID":"a47bf8d5-79a6-4552-887e-793d64a1ba99","Type":"ContainerStarted","Data":"b2bfb6327aa3ec23d897a6b32e714969401ea5aa29a642dd9f434c5f1195c0b7"}
Sep 10 19:27:27.445638 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:27.445599    2558 generic.go:356] "Generic (PLEG): container finished" podID="a47bf8d5-79a6-4552-887e-793d64a1ba99" containerID="b2bfb6327aa3ec23d897a6b32e714969401ea5aa29a642dd9f434c5f1195c0b7" exitCode=0
Sep 10 19:27:27.446024 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:27.445663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb" event={"ID":"a47bf8d5-79a6-4552-887e-793d64a1ba99","Type":"ContainerDied","Data":"b2bfb6327aa3ec23d897a6b32e714969401ea5aa29a642dd9f434c5f1195c0b7"}
Sep 10 19:27:28.453955 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:28.453917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb" event={"ID":"a47bf8d5-79a6-4552-887e-793d64a1ba99","Type":"ContainerStarted","Data":"9e23f9561370ea85ea4729bafc9c0912d8b7a1bd0376b2b576ace3313121809c"}
Sep 10 19:27:28.454348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:28.454056    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:28.497545 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:28.497488    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb" podStartSLOduration=2.008019004 podStartE2EDuration="6.497469134s" totalImagesPullingTime="3.47189595s" totalInitContainerRuntime="1.01755418s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:27:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:27:28.49743168 +0000 UTC m=+437.314041275" watchObservedRunningTime="2026-09-10 19:27:28.497469134 +0000 UTC m=+437.314078728"
Sep 10 19:27:34.513569 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.513483    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"]
Sep 10 19:27:34.522179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.522157    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.528101 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.528072    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 19:27:34.528101 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.528091    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 19:27:34.528595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.528571    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s7mzv\""
Sep 10 19:27:34.529704 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.529678    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"]
Sep 10 19:27:34.701508 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.701471    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.701508 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.701509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.701714 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.701536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqql\" (UniqueName: \"kubernetes.io/projected/c0bb2180-8e1d-4939-81b8-133079cc1b9b-kube-api-access-rnqql\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.802233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.802159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.802233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.802191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.802233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.802214    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqql\" (UniqueName: \"kubernetes.io/projected/c0bb2180-8e1d-4939-81b8-133079cc1b9b-kube-api-access-rnqql\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.802577 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.802552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.802625 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.802576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.810258 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.810230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqql\" (UniqueName: \"kubernetes.io/projected/c0bb2180-8e1d-4939-81b8-133079cc1b9b-kube-api-access-rnqql\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:34.832199 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:34.832177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:35.101669 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:35.101594    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"]
Sep 10 19:27:35.104871 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:27:35.104843    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bb2180_8e1d_4939_81b8_133079cc1b9b.slice/crio-bd6147658fc39e109cbd6099aa441f91cbd2c9e6f816787f48ce3d72e4656ec3 WatchSource:0}: Error finding container bd6147658fc39e109cbd6099aa441f91cbd2c9e6f816787f48ce3d72e4656ec3: Status 404 returned error can't find the container with id bd6147658fc39e109cbd6099aa441f91cbd2c9e6f816787f48ce3d72e4656ec3
Sep 10 19:27:35.487737 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:35.487695    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerID="81eb91a9cd80d570951093473798d5b0c63cf1985f26f9225333a0ecf3513398" exitCode=0
Sep 10 19:27:35.487935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:35.487784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff" event={"ID":"c0bb2180-8e1d-4939-81b8-133079cc1b9b","Type":"ContainerDied","Data":"81eb91a9cd80d570951093473798d5b0c63cf1985f26f9225333a0ecf3513398"}
Sep 10 19:27:35.487935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:35.487834    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff" event={"ID":"c0bb2180-8e1d-4939-81b8-133079cc1b9b","Type":"ContainerStarted","Data":"bd6147658fc39e109cbd6099aa441f91cbd2c9e6f816787f48ce3d72e4656ec3"}
Sep 10 19:27:36.493878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:36.493845    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerID="4248182771caa7859c90e71a57321c88d0b52078182b77bd079d030b70e6b9ef" exitCode=0
Sep 10 19:27:36.494244 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:36.493917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff" event={"ID":"c0bb2180-8e1d-4939-81b8-133079cc1b9b","Type":"ContainerDied","Data":"4248182771caa7859c90e71a57321c88d0b52078182b77bd079d030b70e6b9ef"}
Sep 10 19:27:37.500324 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:37.500286    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerID="093521b0dd2e022c282aa305d81a1656213574de6dffc56cb447f8cc8fed9906" exitCode=0
Sep 10 19:27:37.500715 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:37.500384    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff" event={"ID":"c0bb2180-8e1d-4939-81b8-133079cc1b9b","Type":"ContainerDied","Data":"093521b0dd2e022c282aa305d81a1656213574de6dffc56cb447f8cc8fed9906"}
Sep 10 19:27:38.624712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.624687    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:38.733774 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.733744    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnqql\" (UniqueName: \"kubernetes.io/projected/c0bb2180-8e1d-4939-81b8-133079cc1b9b-kube-api-access-rnqql\") pod \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") "
Sep 10 19:27:38.733957 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.733808    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-bundle\") pod \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") "
Sep 10 19:27:38.733957 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.733857    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-util\") pod \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\" (UID: \"c0bb2180-8e1d-4939-81b8-133079cc1b9b\") "
Sep 10 19:27:38.734760 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.734724    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-bundle" (OuterVolumeSpecName: "bundle") pod "c0bb2180-8e1d-4939-81b8-133079cc1b9b" (UID: "c0bb2180-8e1d-4939-81b8-133079cc1b9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:27:38.735933 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.735909    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0bb2180-8e1d-4939-81b8-133079cc1b9b-kube-api-access-rnqql" (OuterVolumeSpecName: "kube-api-access-rnqql") pod "c0bb2180-8e1d-4939-81b8-133079cc1b9b" (UID: "c0bb2180-8e1d-4939-81b8-133079cc1b9b"). InnerVolumeSpecName "kube-api-access-rnqql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:27:38.739603 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.739571    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-util" (OuterVolumeSpecName: "util") pod "c0bb2180-8e1d-4939-81b8-133079cc1b9b" (UID: "c0bb2180-8e1d-4939-81b8-133079cc1b9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:27:38.834810 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.834745    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:27:38.834810 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.834770    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnqql\" (UniqueName: \"kubernetes.io/projected/c0bb2180-8e1d-4939-81b8-133079cc1b9b-kube-api-access-rnqql\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:27:38.834810 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:38.834780    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2180-8e1d-4939-81b8-133079cc1b9b-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:27:39.461369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:39.461335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5ddcddd787-cnlmb"
Sep 10 19:27:39.510497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:39.510472    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff"
Sep 10 19:27:39.510497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:39.510484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nqcff" event={"ID":"c0bb2180-8e1d-4939-81b8-133079cc1b9b","Type":"ContainerDied","Data":"bd6147658fc39e109cbd6099aa441f91cbd2c9e6f816787f48ce3d72e4656ec3"}
Sep 10 19:27:39.510672 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:39.510525    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd6147658fc39e109cbd6099aa441f91cbd2c9e6f816787f48ce3d72e4656ec3"
Sep 10 19:27:42.747721 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.747685    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"]
Sep 10 19:27:42.748089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.747997    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerName="pull"
Sep 10 19:27:42.748089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.748009    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerName="pull"
Sep 10 19:27:42.748089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.748021    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerName="util"
Sep 10 19:27:42.748089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.748040    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerName="util"
Sep 10 19:27:42.748089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.748054    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerName="extract"
Sep 10 19:27:42.748089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.748061    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerName="extract"
Sep 10 19:27:42.748267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.748122    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0bb2180-8e1d-4939-81b8-133079cc1b9b" containerName="extract"
Sep 10 19:27:42.751402 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.751365    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.758067 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.758047    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 19:27:42.758172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.758113    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-flmcj\""
Sep 10 19:27:42.759223 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.759207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 19:27:42.759284 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.759242    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 19:27:42.764193 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.764177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86xsx\" (UniqueName: \"kubernetes.io/projected/8ecde841-dbdf-44d4-bec8-27d21092be6b-kube-api-access-86xsx\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.764248 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.764233    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ecde841-dbdf-44d4-bec8-27d21092be6b-tmp\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.764291 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.764273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ecde841-dbdf-44d4-bec8-27d21092be6b-tls-certs\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.765366 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.765350    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 19:27:42.790120 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.790090    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"]
Sep 10 19:27:42.864722 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.864684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ecde841-dbdf-44d4-bec8-27d21092be6b-tmp\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.864913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.864734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ecde841-dbdf-44d4-bec8-27d21092be6b-tls-certs\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.864913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.864798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86xsx\" (UniqueName: \"kubernetes.io/projected/8ecde841-dbdf-44d4-bec8-27d21092be6b-kube-api-access-86xsx\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.865028 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:27:42.864920    2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 19:27:42.865028 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:27:42.864996    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ecde841-dbdf-44d4-bec8-27d21092be6b-tls-certs podName:8ecde841-dbdf-44d4-bec8-27d21092be6b nodeName:}" failed. No retries permitted until 2026-09-10 19:27:43.364973857 +0000 UTC m=+452.181583412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8ecde841-dbdf-44d4-bec8-27d21092be6b-tls-certs") pod "kube-auth-proxy-cf7f4d9c5-5dqd9" (UID: "8ecde841-dbdf-44d4-bec8-27d21092be6b") : secret "kube-auth-proxy-tls" not found
Sep 10 19:27:42.867046 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.867027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ecde841-dbdf-44d4-bec8-27d21092be6b-tmp\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:42.908035 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:42.908003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86xsx\" (UniqueName: \"kubernetes.io/projected/8ecde841-dbdf-44d4-bec8-27d21092be6b-kube-api-access-86xsx\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:43.368868 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:43.368830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ecde841-dbdf-44d4-bec8-27d21092be6b-tls-certs\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:43.371237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:43.371208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ecde841-dbdf-44d4-bec8-27d21092be6b-tls-certs\") pod \"kube-auth-proxy-cf7f4d9c5-5dqd9\" (UID: \"8ecde841-dbdf-44d4-bec8-27d21092be6b\") " pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:43.660686 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:43.660614    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"
Sep 10 19:27:43.962705 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:43.962677    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9"]
Sep 10 19:27:43.965199 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:27:43.965173    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecde841_dbdf_44d4_bec8_27d21092be6b.slice/crio-e201354b40ec0b526b183f221c4426bab369b35b8589e4018dfb7cf3b5162916 WatchSource:0}: Error finding container e201354b40ec0b526b183f221c4426bab369b35b8589e4018dfb7cf3b5162916: Status 404 returned error can't find the container with id e201354b40ec0b526b183f221c4426bab369b35b8589e4018dfb7cf3b5162916
Sep 10 19:27:44.533666 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.533634    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9" event={"ID":"8ecde841-dbdf-44d4-bec8-27d21092be6b","Type":"ContainerStarted","Data":"e201354b40ec0b526b183f221c4426bab369b35b8589e4018dfb7cf3b5162916"}
Sep 10 19:27:44.628199 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.628161    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"]
Sep 10 19:27:44.633008 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.632974    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.641424 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.641395    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 19:27:44.642251 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.642224    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f9mnq\""
Sep 10 19:27:44.642670 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.642521    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 19:27:44.642766 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.642747    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 19:27:44.642883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.642858    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 19:27:44.652012 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.651983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"]
Sep 10 19:27:44.678501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.678466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.678641 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.678517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.678641 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.678549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.678641 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.678581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e267ae-6887-410b-8a2f-8af2ba1357a5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.678806 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.678677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.678806 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.678744    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.678905 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.678831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsm77\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-kube-api-access-fsm77\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.779757 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.779721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.779757 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.779764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e267ae-6887-410b-8a2f-8af2ba1357a5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.779999 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.779785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.779999 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.779917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.779999 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.779978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsm77\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-kube-api-access-fsm77\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.780158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.780059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.780158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.780092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.780593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.780564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.782356 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.782328    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e267ae-6887-410b-8a2f-8af2ba1357a5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.782714 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.782690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.782820 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.782712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.782820 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.782721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.789766 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.789718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsm77\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-kube-api-access-fsm77\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.794821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.794798    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2hplc\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:44.947095 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:44.947057    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:45.243877 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:45.243852    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"]
Sep 10 19:27:45.245912 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:27:45.245884    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e267ae_6887_410b_8a2f_8af2ba1357a5.slice/crio-550ddf057778ca2a9507625ac775de6dc3e566fa79095bbe5c811d0924c56965 WatchSource:0}: Error finding container 550ddf057778ca2a9507625ac775de6dc3e566fa79095bbe5c811d0924c56965: Status 404 returned error can't find the container with id 550ddf057778ca2a9507625ac775de6dc3e566fa79095bbe5c811d0924c56965
Sep 10 19:27:45.543575 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:45.543489    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc" event={"ID":"98e267ae-6887-410b-8a2f-8af2ba1357a5","Type":"ContainerStarted","Data":"550ddf057778ca2a9507625ac775de6dc3e566fa79095bbe5c811d0924c56965"}
Sep 10 19:27:47.557216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:47.557125    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9" event={"ID":"8ecde841-dbdf-44d4-bec8-27d21092be6b","Type":"ContainerStarted","Data":"2d8906906cab3ca4a975f2549b628fc05ea221100d1dfe673d0efa8c5e7f7f8d"}
Sep 10 19:27:47.577710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:47.577652    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cf7f4d9c5-5dqd9" podStartSLOduration=2.305630348 podStartE2EDuration="5.577630973s" totalImagesPullingTime="3.272000625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:27:47.574599891 +0000 UTC m=+456.391209482" watchObservedRunningTime="2026-09-10 19:27:47.577630973 +0000 UTC m=+456.394240543"
Sep 10 19:27:49.016933 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:49.016892    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:27:49.017169 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:49.016967    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:27:49.570390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:49.570341    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc" event={"ID":"98e267ae-6887-410b-8a2f-8af2ba1357a5","Type":"ContainerStarted","Data":"bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b"}
Sep 10 19:27:49.570568 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:49.570484    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:49.603250 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:49.603185    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc" podStartSLOduration=1.834468212 podStartE2EDuration="5.603167786s" totalImagesPullingTime="3.768699574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:27:49.603063611 +0000 UTC m=+458.419673206" watchObservedRunningTime="2026-09-10 19:27:49.603167786 +0000 UTC m=+458.419777353"
Sep 10 19:27:50.577330 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:50.577301    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-2hplc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:27:50.577723 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:50.577347    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc" podUID="98e267ae-6887-410b-8a2f-8af2ba1357a5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:27:53.208598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.208549    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qmg2w"]
Sep 10 19:27:53.212847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.212827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:53.215918 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.215895    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8l8bv\""
Sep 10 19:27:53.216018 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.216001    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 19:27:53.222174 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.222152    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qmg2w"]
Sep 10 19:27:53.260671 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.260638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/657e27db-6f13-4e82-b46b-50f90846c81c-cert\") pod \"odh-model-controller-7998c67dc4-qmg2w\" (UID: \"657e27db-6f13-4e82-b46b-50f90846c81c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:53.260671 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.260673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjhf\" (UniqueName: \"kubernetes.io/projected/657e27db-6f13-4e82-b46b-50f90846c81c-kube-api-access-6vjhf\") pod \"odh-model-controller-7998c67dc4-qmg2w\" (UID: \"657e27db-6f13-4e82-b46b-50f90846c81c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:53.362041 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.362005    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/657e27db-6f13-4e82-b46b-50f90846c81c-cert\") pod \"odh-model-controller-7998c67dc4-qmg2w\" (UID: \"657e27db-6f13-4e82-b46b-50f90846c81c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:53.362041 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.362045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjhf\" (UniqueName: \"kubernetes.io/projected/657e27db-6f13-4e82-b46b-50f90846c81c-kube-api-access-6vjhf\") pod \"odh-model-controller-7998c67dc4-qmg2w\" (UID: \"657e27db-6f13-4e82-b46b-50f90846c81c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:53.362287 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:27:53.362173    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 19:27:53.362287 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:27:53.362249    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/657e27db-6f13-4e82-b46b-50f90846c81c-cert podName:657e27db-6f13-4e82-b46b-50f90846c81c nodeName:}" failed. No retries permitted until 2026-09-10 19:27:53.862227052 +0000 UTC m=+462.678836614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/657e27db-6f13-4e82-b46b-50f90846c81c-cert") pod "odh-model-controller-7998c67dc4-qmg2w" (UID: "657e27db-6f13-4e82-b46b-50f90846c81c") : secret "odh-model-controller-webhook-cert" not found
Sep 10 19:27:53.373831 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.373798    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjhf\" (UniqueName: \"kubernetes.io/projected/657e27db-6f13-4e82-b46b-50f90846c81c-kube-api-access-6vjhf\") pod \"odh-model-controller-7998c67dc4-qmg2w\" (UID: \"657e27db-6f13-4e82-b46b-50f90846c81c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:53.577069 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.576987    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:27:53.867145 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.867057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/657e27db-6f13-4e82-b46b-50f90846c81c-cert\") pod \"odh-model-controller-7998c67dc4-qmg2w\" (UID: \"657e27db-6f13-4e82-b46b-50f90846c81c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:53.869638 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:53.869614    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/657e27db-6f13-4e82-b46b-50f90846c81c-cert\") pod \"odh-model-controller-7998c67dc4-qmg2w\" (UID: \"657e27db-6f13-4e82-b46b-50f90846c81c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:54.123544 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:54.123460    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:54.399914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:54.399887    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qmg2w"]
Sep 10 19:27:54.402657 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:27:54.402614    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657e27db_6f13_4e82_b46b_50f90846c81c.slice/crio-514eaea1373ce7562b3f3d33ea9b864edb4d52d1bdbce7135e099d32084c5022 WatchSource:0}: Error finding container 514eaea1373ce7562b3f3d33ea9b864edb4d52d1bdbce7135e099d32084c5022: Status 404 returned error can't find the container with id 514eaea1373ce7562b3f3d33ea9b864edb4d52d1bdbce7135e099d32084c5022
Sep 10 19:27:54.598745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:54.598712    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w" event={"ID":"657e27db-6f13-4e82-b46b-50f90846c81c","Type":"ContainerStarted","Data":"514eaea1373ce7562b3f3d33ea9b864edb4d52d1bdbce7135e099d32084c5022"}
Sep 10 19:27:58.623109 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:58.623072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w" event={"ID":"657e27db-6f13-4e82-b46b-50f90846c81c","Type":"ContainerStarted","Data":"10d10fc086d1bdd52cf998680c20cfe0607b489486b8edbe004547c241e6892c"}
Sep 10 19:27:58.623553 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:58.623147    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:27:58.644263 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:27:58.644212    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w" podStartSLOduration=2.361248426 podStartE2EDuration="5.644196592s" totalImagesPullingTime="3.282948166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:27:58.641965062 +0000 UTC m=+467.458574658" watchObservedRunningTime="2026-09-10 19:27:58.644196592 +0000 UTC m=+467.460806168"
Sep 10 19:28:01.584042 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.584003    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"]
Sep 10 19:28:01.594261 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.594237    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.682016 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.681983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"]
Sep 10 19:28:01.737156 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.737122    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.737156 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.737157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.737335 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.737176    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.737335 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.737204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43d6a214-30fd-4836-88bb-c443c5da6135-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.737335 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.737251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43d6a214-30fd-4836-88bb-c443c5da6135-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.737335 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.737320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhxpt\" (UniqueName: \"kubernetes.io/projected/43d6a214-30fd-4836-88bb-c443c5da6135-kube-api-access-mhxpt\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.737484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.737353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43d6a214-30fd-4836-88bb-c443c5da6135-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.837854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.837773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.837854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.837813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.837854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.837835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.838136 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.837864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43d6a214-30fd-4836-88bb-c443c5da6135-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.838136 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.837905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43d6a214-30fd-4836-88bb-c443c5da6135-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.838136 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.837954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhxpt\" (UniqueName: \"kubernetes.io/projected/43d6a214-30fd-4836-88bb-c443c5da6135-kube-api-access-mhxpt\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.838136 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.838106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43d6a214-30fd-4836-88bb-c443c5da6135-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.838817 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.838784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43d6a214-30fd-4836-88bb-c443c5da6135-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.840509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.840479    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43d6a214-30fd-4836-88bb-c443c5da6135-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.840690 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.840662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.840815 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.840734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.840815 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.840769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43d6a214-30fd-4836-88bb-c443c5da6135-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.859653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.859628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43d6a214-30fd-4836-88bb-c443c5da6135-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.871080 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.871052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhxpt\" (UniqueName: \"kubernetes.io/projected/43d6a214-30fd-4836-88bb-c443c5da6135-kube-api-access-mhxpt\") pod \"istiod-openshift-gateway-5677ccb49b-z8nkm\" (UID: \"43d6a214-30fd-4836-88bb-c443c5da6135\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:01.903917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:01.903890    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:02.220938 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:02.220917    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"]
Sep 10 19:28:02.223336 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:28:02.223315    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d6a214_30fd_4836_88bb_c443c5da6135.slice/crio-6212f5d5afdd00b2a532d2f276abe781468f2e7b2e4166f3f843fe54010e922d WatchSource:0}: Error finding container 6212f5d5afdd00b2a532d2f276abe781468f2e7b2e4166f3f843fe54010e922d: Status 404 returned error can't find the container with id 6212f5d5afdd00b2a532d2f276abe781468f2e7b2e4166f3f843fe54010e922d
Sep 10 19:28:02.226293 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:02.226265    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:28:02.226348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:02.226325    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:28:02.645680 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:02.645587    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm" event={"ID":"43d6a214-30fd-4836-88bb-c443c5da6135","Type":"ContainerStarted","Data":"701894bb2e0140114c491630ab9ea46cbd808acc1877532dc812a7c76edc83a6"}
Sep 10 19:28:02.645680 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:02.645643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm" event={"ID":"43d6a214-30fd-4836-88bb-c443c5da6135","Type":"ContainerStarted","Data":"6212f5d5afdd00b2a532d2f276abe781468f2e7b2e4166f3f843fe54010e922d"}
Sep 10 19:28:02.646460 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:02.645757    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:02.690700 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:02.690637    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm" podStartSLOduration=1.690614446 podStartE2EDuration="1.690614446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:28:02.688628151 +0000 UTC m=+471.505237744" watchObservedRunningTime="2026-09-10 19:28:02.690614446 +0000 UTC m=+471.507224016"
Sep 10 19:28:03.654600 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:03.654565    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-z8nkm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:28:03.654973 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:03.654624    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm" podUID="43d6a214-30fd-4836-88bb-c443c5da6135" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:28:06.654201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:06.654166    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8nkm"
Sep 10 19:28:06.758795 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:06.758765    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"]
Sep 10 19:28:06.758972 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:06.758950    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc" podUID="98e267ae-6887-410b-8a2f-8af2ba1357a5" containerName="discovery" containerID="cri-o://bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b" gracePeriod=30
Sep 10 19:28:06.993105 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:06.993081    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:28:07.088897 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.088861    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e267ae-6887-410b-8a2f-8af2ba1357a5-local-certs\") pod \"98e267ae-6887-410b-8a2f-8af2ba1357a5\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") "
Sep 10 19:28:07.089060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.088910    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-cacerts\") pod \"98e267ae-6887-410b-8a2f-8af2ba1357a5\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") "
Sep 10 19:28:07.089060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.088949    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsm77\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-kube-api-access-fsm77\") pod \"98e267ae-6887-410b-8a2f-8af2ba1357a5\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") "
Sep 10 19:28:07.089060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.088981    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-ca-configmap\") pod \"98e267ae-6887-410b-8a2f-8af2ba1357a5\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") "
Sep 10 19:28:07.089060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.089006    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-kubeconfig\") pod \"98e267ae-6887-410b-8a2f-8af2ba1357a5\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") "
Sep 10 19:28:07.089238 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.089077    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-token\") pod \"98e267ae-6887-410b-8a2f-8af2ba1357a5\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") "
Sep 10 19:28:07.089238 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.089109    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-dns-cert\") pod \"98e267ae-6887-410b-8a2f-8af2ba1357a5\" (UID: \"98e267ae-6887-410b-8a2f-8af2ba1357a5\") "
Sep 10 19:28:07.089498 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.089450    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "98e267ae-6887-410b-8a2f-8af2ba1357a5" (UID: "98e267ae-6887-410b-8a2f-8af2ba1357a5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:28:07.091384 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.091335    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "98e267ae-6887-410b-8a2f-8af2ba1357a5" (UID: "98e267ae-6887-410b-8a2f-8af2ba1357a5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:28:07.091507 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.091479    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "98e267ae-6887-410b-8a2f-8af2ba1357a5" (UID: "98e267ae-6887-410b-8a2f-8af2ba1357a5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:28:07.091622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.091589    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-cacerts" (OuterVolumeSpecName: "cacerts") pod "98e267ae-6887-410b-8a2f-8af2ba1357a5" (UID: "98e267ae-6887-410b-8a2f-8af2ba1357a5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:28:07.091686 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.091658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e267ae-6887-410b-8a2f-8af2ba1357a5-local-certs" (OuterVolumeSpecName: "local-certs") pod "98e267ae-6887-410b-8a2f-8af2ba1357a5" (UID: "98e267ae-6887-410b-8a2f-8af2ba1357a5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:28:07.091686 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.091668    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-kube-api-access-fsm77" (OuterVolumeSpecName: "kube-api-access-fsm77") pod "98e267ae-6887-410b-8a2f-8af2ba1357a5" (UID: "98e267ae-6887-410b-8a2f-8af2ba1357a5"). InnerVolumeSpecName "kube-api-access-fsm77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:28:07.091761 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.091722    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "98e267ae-6887-410b-8a2f-8af2ba1357a5" (UID: "98e267ae-6887-410b-8a2f-8af2ba1357a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:28:07.190140 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.190104    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:28:07.190140 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.190143    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-dns-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:28:07.190341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.190158    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e267ae-6887-410b-8a2f-8af2ba1357a5-local-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:28:07.190341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.190172    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-cacerts\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:28:07.190341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.190187    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsm77\" (UniqueName: \"kubernetes.io/projected/98e267ae-6887-410b-8a2f-8af2ba1357a5-kube-api-access-fsm77\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:28:07.190341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.190200    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-csr-ca-configmap\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:28:07.190341 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.190212    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98e267ae-6887-410b-8a2f-8af2ba1357a5-istio-kubeconfig\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:28:07.670074 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.670040    2558 generic.go:356] "Generic (PLEG): container finished" podID="98e267ae-6887-410b-8a2f-8af2ba1357a5" containerID="bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b" exitCode=0
Sep 10 19:28:07.670440 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.670083    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"
Sep 10 19:28:07.670440 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.670117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc" event={"ID":"98e267ae-6887-410b-8a2f-8af2ba1357a5","Type":"ContainerDied","Data":"bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b"}
Sep 10 19:28:07.670440 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.670167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc" event={"ID":"98e267ae-6887-410b-8a2f-8af2ba1357a5","Type":"ContainerDied","Data":"550ddf057778ca2a9507625ac775de6dc3e566fa79095bbe5c811d0924c56965"}
Sep 10 19:28:07.670440 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.670187    2558 scope.go:117] "RemoveContainer" containerID="bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b"
Sep 10 19:28:07.678557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.678542    2558 scope.go:117] "RemoveContainer" containerID="bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b"
Sep 10 19:28:07.678841 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:28:07.678820    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b\": container with ID starting with bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b not found: ID does not exist" containerID="bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b"
Sep 10 19:28:07.678888 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.678850    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b"} err="failed to get container status \"bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b\": rpc error: code = NotFound desc = could not find container \"bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b\": container with ID starting with bdb2c2e4a9b8b8d2f6a806d261cf1200856434078be558fea4b4de0a4315885b not found: ID does not exist"
Sep 10 19:28:07.699029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.698996    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"]
Sep 10 19:28:07.714218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:07.714183    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2hplc"]
Sep 10 19:28:09.639812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:09.639779    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qmg2w"
Sep 10 19:28:09.655757 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:09.655726    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e267ae-6887-410b-8a2f-8af2ba1357a5" path="/var/lib/kubelet/pods/98e267ae-6887-410b-8a2f-8af2ba1357a5/volumes"
Sep 10 19:28:59.017094 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.017061    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"]
Sep 10 19:28:59.017539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.017425    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e267ae-6887-410b-8a2f-8af2ba1357a5" containerName="discovery"
Sep 10 19:28:59.017539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.017436    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e267ae-6887-410b-8a2f-8af2ba1357a5" containerName="discovery"
Sep 10 19:28:59.017539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.017489    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e267ae-6887-410b-8a2f-8af2ba1357a5" containerName="discovery"
Sep 10 19:28:59.020620 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.020600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.026899 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.026867    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 19:28:59.028621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.027158    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 19:28:59.028621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.027586    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s7mzv\""
Sep 10 19:28:59.036572 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.036550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"]
Sep 10 19:28:59.107090 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.107055    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"]
Sep 10 19:28:59.110410 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.110393    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.121216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.121191    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"]
Sep 10 19:28:59.122539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.122510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.122645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.122587    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.122645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.122628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-259lk\" (UniqueName: \"kubernetes.io/projected/0e31fdae-baf1-4c78-821e-b7a0641776d2-kube-api-access-259lk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.189490 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.189455    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"]
Sep 10 19:28:59.193031 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.193007    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.201568 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.201544    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"]
Sep 10 19:28:59.223907 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.223880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.224017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.223913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-259lk\" (UniqueName: \"kubernetes.io/projected/0e31fdae-baf1-4c78-821e-b7a0641776d2-kube-api-access-259lk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.224017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.223964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.224017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.223986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.224017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.224011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.224170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.224027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjkb\" (UniqueName: \"kubernetes.io/projected/d8732014-1a3f-4124-b26a-411ef5d47faf-kube-api-access-nwjkb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.224264 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.224243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.224298 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.224272    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.232130 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.232102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-259lk\" (UniqueName: \"kubernetes.io/projected/0e31fdae-baf1-4c78-821e-b7a0641776d2-kube-api-access-259lk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.299836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.299767    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"]
Sep 10 19:28:59.303311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.303294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.313842 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.313819    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"]
Sep 10 19:28:59.324856 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.324833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjwps\" (UniqueName: \"kubernetes.io/projected/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-kube-api-access-pjwps\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.324974 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.324862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.324974 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.324891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.325116 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.324970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.325116 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.325002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjkb\" (UniqueName: \"kubernetes.io/projected/d8732014-1a3f-4124-b26a-411ef5d47faf-kube-api-access-nwjkb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.325116 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.325032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.325663 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.325609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.325850 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.325824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.335448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.335424    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:28:59.335813 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.335793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjkb\" (UniqueName: \"kubernetes.io/projected/d8732014-1a3f-4124-b26a-411ef5d47faf-kube-api-access-nwjkb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.420079 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.419852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.427767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.427831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq2vf\" (UniqueName: \"kubernetes.io/projected/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-kube-api-access-zq2vf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.427866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.427913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.427960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjwps\" (UniqueName: \"kubernetes.io/projected/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-kube-api-access-pjwps\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.427987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.428361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.428703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.428694    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.437686 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.437660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjwps\" (UniqueName: \"kubernetes.io/projected/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-kube-api-access-pjwps\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.503369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.503335    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:28:59.528944 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.528911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq2vf\" (UniqueName: \"kubernetes.io/projected/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-kube-api-access-zq2vf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.529096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.528952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.529096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.528999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.529430 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.529410    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.529506 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.529426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.537728 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.537699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq2vf\" (UniqueName: \"kubernetes.io/projected/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-kube-api-access-zq2vf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.613625 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.613167    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:28:59.616001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.615973    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"]
Sep 10 19:28:59.617768 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:28:59.617746    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e31fdae_baf1_4c78_821e_b7a0641776d2.slice/crio-9c790a363bd9f00792ea64f76164352dd66be43c53d64e5aa0b2ddc0cf733d40 WatchSource:0}: Error finding container 9c790a363bd9f00792ea64f76164352dd66be43c53d64e5aa0b2ddc0cf733d40: Status 404 returned error can't find the container with id 9c790a363bd9f00792ea64f76164352dd66be43c53d64e5aa0b2ddc0cf733d40
Sep 10 19:28:59.703263 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.703240    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"]
Sep 10 19:28:59.705590 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:28:59.705567    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8732014_1a3f_4124_b26a_411ef5d47faf.slice/crio-6e835234551cf9b1e05f07b4d81ba985ce195178844af178badaec5d44abcb2b WatchSource:0}: Error finding container 6e835234551cf9b1e05f07b4d81ba985ce195178844af178badaec5d44abcb2b: Status 404 returned error can't find the container with id 6e835234551cf9b1e05f07b4d81ba985ce195178844af178badaec5d44abcb2b
Sep 10 19:28:59.779517 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.779494    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"]
Sep 10 19:28:59.800335 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:28:59.800311    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08391bf_46c0_4761_bd62_cc2eb0c80d6a.slice/crio-61fa767adee7035b0bf35797efc34d1c5afbd6f4fd98e08e20ff144fa5e6b854 WatchSource:0}: Error finding container 61fa767adee7035b0bf35797efc34d1c5afbd6f4fd98e08e20ff144fa5e6b854: Status 404 returned error can't find the container with id 61fa767adee7035b0bf35797efc34d1c5afbd6f4fd98e08e20ff144fa5e6b854
Sep 10 19:28:59.891537 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.891513    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"]
Sep 10 19:28:59.909392 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.909344    2558 generic.go:356] "Generic (PLEG): container finished" podID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerID="736f167a0bd6d670ba1f5ac09bd6eacf8c5338bff4257f97936aeaee74c46602" exitCode=0
Sep 10 19:28:59.909480 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.909423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk" event={"ID":"c08391bf-46c0-4761-bd62-cc2eb0c80d6a","Type":"ContainerDied","Data":"736f167a0bd6d670ba1f5ac09bd6eacf8c5338bff4257f97936aeaee74c46602"}
Sep 10 19:28:59.909480 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.909468    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk" event={"ID":"c08391bf-46c0-4761-bd62-cc2eb0c80d6a","Type":"ContainerStarted","Data":"61fa767adee7035b0bf35797efc34d1c5afbd6f4fd98e08e20ff144fa5e6b854"}
Sep 10 19:28:59.911204 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.911179    2558 generic.go:356] "Generic (PLEG): container finished" podID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerID="0b3c71e5f8cc1645d73a28af0fd1566f24b731f08329968f7e0f1cf11bf17f4b" exitCode=0
Sep 10 19:28:59.911305 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.911258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58" event={"ID":"0e31fdae-baf1-4c78-821e-b7a0641776d2","Type":"ContainerDied","Data":"0b3c71e5f8cc1645d73a28af0fd1566f24b731f08329968f7e0f1cf11bf17f4b"}
Sep 10 19:28:59.911305 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.911292    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58" event={"ID":"0e31fdae-baf1-4c78-821e-b7a0641776d2","Type":"ContainerStarted","Data":"9c790a363bd9f00792ea64f76164352dd66be43c53d64e5aa0b2ddc0cf733d40"}
Sep 10 19:28:59.913099 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.913034    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerID="93027ad0c34d3f39dac4c515e36831208e74a9f353e2142c00fae2ddd9652e4c" exitCode=0
Sep 10 19:28:59.913099 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.913098    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m" event={"ID":"d8732014-1a3f-4124-b26a-411ef5d47faf","Type":"ContainerDied","Data":"93027ad0c34d3f39dac4c515e36831208e74a9f353e2142c00fae2ddd9652e4c"}
Sep 10 19:28:59.913496 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:28:59.913135    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m" event={"ID":"d8732014-1a3f-4124-b26a-411ef5d47faf","Type":"ContainerStarted","Data":"6e835234551cf9b1e05f07b4d81ba985ce195178844af178badaec5d44abcb2b"}
Sep 10 19:28:59.913496 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:28:59.913422    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db7cde2_a53a_4ce1_af08_f3d94092b9f2.slice/crio-408268d99156ccd976e174b18557a8c0ba7892c5f8c51b5355d181c65216777e WatchSource:0}: Error finding container 408268d99156ccd976e174b18557a8c0ba7892c5f8c51b5355d181c65216777e: Status 404 returned error can't find the container with id 408268d99156ccd976e174b18557a8c0ba7892c5f8c51b5355d181c65216777e
Sep 10 19:29:00.920119 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:00.920027    2558 generic.go:356] "Generic (PLEG): container finished" podID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerID="99054fdf5df7000790d15bca85a723dfc5c19a66b0b605d5b7028e351a87dbde" exitCode=0
Sep 10 19:29:00.920441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:00.920115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx" event={"ID":"4db7cde2-a53a-4ce1-af08-f3d94092b9f2","Type":"ContainerDied","Data":"99054fdf5df7000790d15bca85a723dfc5c19a66b0b605d5b7028e351a87dbde"}
Sep 10 19:29:00.920441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:00.920167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx" event={"ID":"4db7cde2-a53a-4ce1-af08-f3d94092b9f2","Type":"ContainerStarted","Data":"408268d99156ccd976e174b18557a8c0ba7892c5f8c51b5355d181c65216777e"}
Sep 10 19:29:00.922105 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:00.922079    2558 generic.go:356] "Generic (PLEG): container finished" podID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerID="a0e2df923c34b14a919efa55e3c59f864d528d757bfd6e653c8a3bc9157f580e" exitCode=0
Sep 10 19:29:00.922197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:00.922128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58" event={"ID":"0e31fdae-baf1-4c78-821e-b7a0641776d2","Type":"ContainerDied","Data":"a0e2df923c34b14a919efa55e3c59f864d528d757bfd6e653c8a3bc9157f580e"}
Sep 10 19:29:01.928560 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.928519    2558 generic.go:356] "Generic (PLEG): container finished" podID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerID="d4188a03a90213e0752333c50fbc16a97effd467cfb8b00cd160fb1db82ab836" exitCode=0
Sep 10 19:29:01.928957 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.928586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx" event={"ID":"4db7cde2-a53a-4ce1-af08-f3d94092b9f2","Type":"ContainerDied","Data":"d4188a03a90213e0752333c50fbc16a97effd467cfb8b00cd160fb1db82ab836"}
Sep 10 19:29:01.930574 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.930548    2558 generic.go:356] "Generic (PLEG): container finished" podID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerID="535c59af952aeaa12adcf575e00ddbbfec6f4e4ac35c5e6cfc8bc06ed659c502" exitCode=0
Sep 10 19:29:01.930686 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.930630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk" event={"ID":"c08391bf-46c0-4761-bd62-cc2eb0c80d6a","Type":"ContainerDied","Data":"535c59af952aeaa12adcf575e00ddbbfec6f4e4ac35c5e6cfc8bc06ed659c502"}
Sep 10 19:29:01.933031 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.933010    2558 generic.go:356] "Generic (PLEG): container finished" podID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerID="b81b85c0acf42254a38e7d5c2ef3966490a6f56955dc36f5eedc50ca1de5eb81" exitCode=0
Sep 10 19:29:01.933118 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.933087    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58" event={"ID":"0e31fdae-baf1-4c78-821e-b7a0641776d2","Type":"ContainerDied","Data":"b81b85c0acf42254a38e7d5c2ef3966490a6f56955dc36f5eedc50ca1de5eb81"}
Sep 10 19:29:01.935080 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.935060    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerID="1f5a3494e91fe8bf5eb45098d5064f69d8a0ab66441ca6a106b30c884ffd5174" exitCode=0
Sep 10 19:29:01.935170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:01.935091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m" event={"ID":"d8732014-1a3f-4124-b26a-411ef5d47faf","Type":"ContainerDied","Data":"1f5a3494e91fe8bf5eb45098d5064f69d8a0ab66441ca6a106b30c884ffd5174"}
Sep 10 19:29:02.943242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:02.943207    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerID="7dd63bb63420f314ade817010eadb2b49822bd63ee03d69c28241322ee8b0ea0" exitCode=0
Sep 10 19:29:02.943667 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:02.943285    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m" event={"ID":"d8732014-1a3f-4124-b26a-411ef5d47faf","Type":"ContainerDied","Data":"7dd63bb63420f314ade817010eadb2b49822bd63ee03d69c28241322ee8b0ea0"}
Sep 10 19:29:02.945421 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:02.945400    2558 generic.go:356] "Generic (PLEG): container finished" podID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerID="0ac7bd585e3e96bd05da282c37691176a869bf45a1c12f5e47952e7f9ba9280b" exitCode=0
Sep 10 19:29:02.945534 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:02.945481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx" event={"ID":"4db7cde2-a53a-4ce1-af08-f3d94092b9f2","Type":"ContainerDied","Data":"0ac7bd585e3e96bd05da282c37691176a869bf45a1c12f5e47952e7f9ba9280b"}
Sep 10 19:29:02.947636 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:02.947616    2558 generic.go:356] "Generic (PLEG): container finished" podID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerID="ec80f1585d8a792da4ec62195da395579bfc9e5403ecd5e529f5d7fdc32282ab" exitCode=0
Sep 10 19:29:02.947725 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:02.947679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk" event={"ID":"c08391bf-46c0-4761-bd62-cc2eb0c80d6a","Type":"ContainerDied","Data":"ec80f1585d8a792da4ec62195da395579bfc9e5403ecd5e529f5d7fdc32282ab"}
Sep 10 19:29:03.080799 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.080776    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:29:03.162665 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.162625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-util\") pod \"0e31fdae-baf1-4c78-821e-b7a0641776d2\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") "
Sep 10 19:29:03.162841 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.162743    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-bundle\") pod \"0e31fdae-baf1-4c78-821e-b7a0641776d2\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") "
Sep 10 19:29:03.162841 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.162776    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-259lk\" (UniqueName: \"kubernetes.io/projected/0e31fdae-baf1-4c78-821e-b7a0641776d2-kube-api-access-259lk\") pod \"0e31fdae-baf1-4c78-821e-b7a0641776d2\" (UID: \"0e31fdae-baf1-4c78-821e-b7a0641776d2\") "
Sep 10 19:29:03.163260 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.163230    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-bundle" (OuterVolumeSpecName: "bundle") pod "0e31fdae-baf1-4c78-821e-b7a0641776d2" (UID: "0e31fdae-baf1-4c78-821e-b7a0641776d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:03.164902 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.164873    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e31fdae-baf1-4c78-821e-b7a0641776d2-kube-api-access-259lk" (OuterVolumeSpecName: "kube-api-access-259lk") pod "0e31fdae-baf1-4c78-821e-b7a0641776d2" (UID: "0e31fdae-baf1-4c78-821e-b7a0641776d2"). InnerVolumeSpecName "kube-api-access-259lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:29:03.168290 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.168265    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-util" (OuterVolumeSpecName: "util") pod "0e31fdae-baf1-4c78-821e-b7a0641776d2" (UID: "0e31fdae-baf1-4c78-821e-b7a0641776d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:03.264043 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.263959    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:03.264043 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.263990    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-259lk\" (UniqueName: \"kubernetes.io/projected/0e31fdae-baf1-4c78-821e-b7a0641776d2-kube-api-access-259lk\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:03.264043 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.264000    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e31fdae-baf1-4c78-821e-b7a0641776d2-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:03.954620 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.954589    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58"
Sep 10 19:29:03.955058 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.954619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9ms58" event={"ID":"0e31fdae-baf1-4c78-821e-b7a0641776d2","Type":"ContainerDied","Data":"9c790a363bd9f00792ea64f76164352dd66be43c53d64e5aa0b2ddc0cf733d40"}
Sep 10 19:29:03.955058 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:03.954674    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c790a363bd9f00792ea64f76164352dd66be43c53d64e5aa0b2ddc0cf733d40"
Sep 10 19:29:04.101461 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.101425    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:29:04.145702 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.145673    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:29:04.148674 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.148656    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:29:04.174201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.174170    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-bundle\") pod \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") "
Sep 10 19:29:04.174329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.174272    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-util\") pod \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") "
Sep 10 19:29:04.174387 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.174341    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjwps\" (UniqueName: \"kubernetes.io/projected/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-kube-api-access-pjwps\") pod \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\" (UID: \"c08391bf-46c0-4761-bd62-cc2eb0c80d6a\") "
Sep 10 19:29:04.174686 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.174658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-bundle" (OuterVolumeSpecName: "bundle") pod "c08391bf-46c0-4761-bd62-cc2eb0c80d6a" (UID: "c08391bf-46c0-4761-bd62-cc2eb0c80d6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:04.176364 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.176335    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-kube-api-access-pjwps" (OuterVolumeSpecName: "kube-api-access-pjwps") pod "c08391bf-46c0-4761-bd62-cc2eb0c80d6a" (UID: "c08391bf-46c0-4761-bd62-cc2eb0c80d6a"). InnerVolumeSpecName "kube-api-access-pjwps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:29:04.179683 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.179658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-util" (OuterVolumeSpecName: "util") pod "c08391bf-46c0-4761-bd62-cc2eb0c80d6a" (UID: "c08391bf-46c0-4761-bd62-cc2eb0c80d6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:04.275645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.275563    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwjkb\" (UniqueName: \"kubernetes.io/projected/d8732014-1a3f-4124-b26a-411ef5d47faf-kube-api-access-nwjkb\") pod \"d8732014-1a3f-4124-b26a-411ef5d47faf\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") "
Sep 10 19:29:04.275645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.275650    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-bundle\") pod \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") "
Sep 10 19:29:04.275872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.275670    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq2vf\" (UniqueName: \"kubernetes.io/projected/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-kube-api-access-zq2vf\") pod \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") "
Sep 10 19:29:04.275872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.275689    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-util\") pod \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\" (UID: \"4db7cde2-a53a-4ce1-af08-f3d94092b9f2\") "
Sep 10 19:29:04.275872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.275715    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-util\") pod \"d8732014-1a3f-4124-b26a-411ef5d47faf\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") "
Sep 10 19:29:04.275872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.275759    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-bundle\") pod \"d8732014-1a3f-4124-b26a-411ef5d47faf\" (UID: \"d8732014-1a3f-4124-b26a-411ef5d47faf\") "
Sep 10 19:29:04.276065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.276008    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.276065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.276027    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjwps\" (UniqueName: \"kubernetes.io/projected/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-kube-api-access-pjwps\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.276065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.276042    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c08391bf-46c0-4761-bd62-cc2eb0c80d6a-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.276223 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.276193    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-bundle" (OuterVolumeSpecName: "bundle") pod "4db7cde2-a53a-4ce1-af08-f3d94092b9f2" (UID: "4db7cde2-a53a-4ce1-af08-f3d94092b9f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:04.276656 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.276626    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-bundle" (OuterVolumeSpecName: "bundle") pod "d8732014-1a3f-4124-b26a-411ef5d47faf" (UID: "d8732014-1a3f-4124-b26a-411ef5d47faf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:04.277924 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.277892    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8732014-1a3f-4124-b26a-411ef5d47faf-kube-api-access-nwjkb" (OuterVolumeSpecName: "kube-api-access-nwjkb") pod "d8732014-1a3f-4124-b26a-411ef5d47faf" (UID: "d8732014-1a3f-4124-b26a-411ef5d47faf"). InnerVolumeSpecName "kube-api-access-nwjkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:29:04.278217 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.278190    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-kube-api-access-zq2vf" (OuterVolumeSpecName: "kube-api-access-zq2vf") pod "4db7cde2-a53a-4ce1-af08-f3d94092b9f2" (UID: "4db7cde2-a53a-4ce1-af08-f3d94092b9f2"). InnerVolumeSpecName "kube-api-access-zq2vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:29:04.281736 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.281714    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-util" (OuterVolumeSpecName: "util") pod "4db7cde2-a53a-4ce1-af08-f3d94092b9f2" (UID: "4db7cde2-a53a-4ce1-af08-f3d94092b9f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:04.282308 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.282286    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-util" (OuterVolumeSpecName: "util") pod "d8732014-1a3f-4124-b26a-411ef5d47faf" (UID: "d8732014-1a3f-4124-b26a-411ef5d47faf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:04.376432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.376399    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq2vf\" (UniqueName: \"kubernetes.io/projected/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-kube-api-access-zq2vf\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.376432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.376425    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.376432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.376435    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-util\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.376650 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.376443    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8732014-1a3f-4124-b26a-411ef5d47faf-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.376650 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.376451    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwjkb\" (UniqueName: \"kubernetes.io/projected/d8732014-1a3f-4124-b26a-411ef5d47faf-kube-api-access-nwjkb\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.376650 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.376460    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4db7cde2-a53a-4ce1-af08-f3d94092b9f2-bundle\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:04.961539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.961507    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx"
Sep 10 19:29:04.961539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.961514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67bwkx" event={"ID":"4db7cde2-a53a-4ce1-af08-f3d94092b9f2","Type":"ContainerDied","Data":"408268d99156ccd976e174b18557a8c0ba7892c5f8c51b5355d181c65216777e"}
Sep 10 19:29:04.961929 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.961558    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="408268d99156ccd976e174b18557a8c0ba7892c5f8c51b5355d181c65216777e"
Sep 10 19:29:04.963489 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.963469    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk"
Sep 10 19:29:04.963612 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.963497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wl2qk" event={"ID":"c08391bf-46c0-4761-bd62-cc2eb0c80d6a","Type":"ContainerDied","Data":"61fa767adee7035b0bf35797efc34d1c5afbd6f4fd98e08e20ff144fa5e6b854"}
Sep 10 19:29:04.963612 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.963533    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61fa767adee7035b0bf35797efc34d1c5afbd6f4fd98e08e20ff144fa5e6b854"
Sep 10 19:29:04.965469 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.965449    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m" event={"ID":"d8732014-1a3f-4124-b26a-411ef5d47faf","Type":"ContainerDied","Data":"6e835234551cf9b1e05f07b4d81ba985ce195178844af178badaec5d44abcb2b"}
Sep 10 19:29:04.965561 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.965483    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e835234551cf9b1e05f07b4d81ba985ce195178844af178badaec5d44abcb2b"
Sep 10 19:29:04.965561 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:04.965496    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahht6m"
Sep 10 19:29:13.882834 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.882801    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"]
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883102    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerName="extract"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883112    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerName="extract"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883127    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerName="util"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883134    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerName="util"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883142    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerName="util"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883147    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerName="util"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883152    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerName="pull"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883158    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerName="pull"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883167    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerName="pull"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883172    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerName="pull"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883179    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerName="pull"
Sep 10 19:29:13.883177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883184    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerName="pull"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883191    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883196    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883202    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerName="util"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883207    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerName="util"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883217    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerName="util"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883221    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerName="util"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883226    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883231    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883238    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerName="pull"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883244    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerName="pull"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883249    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883253    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883303    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08391bf-46c0-4761-bd62-cc2eb0c80d6a" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883311    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8732014-1a3f-4124-b26a-411ef5d47faf" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883318    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4db7cde2-a53a-4ce1-af08-f3d94092b9f2" containerName="extract"
Sep 10 19:29:13.883546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.883324    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e31fdae-baf1-4c78-821e-b7a0641776d2" containerName="extract"
Sep 10 19:29:13.886157 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.886138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:13.889717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.889683    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 19:29:13.889717 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.889697    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 19:29:13.890505 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.890488    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pldb6\""
Sep 10 19:29:13.936923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:13.936890    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"]
Sep 10 19:29:14.061258 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.061225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99560354-b972-4248-b57b-0d05835a2f34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:14.061437 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.061276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbcgv\" (UniqueName: \"kubernetes.io/projected/99560354-b972-4248-b57b-0d05835a2f34-kube-api-access-vbcgv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:14.162446 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.162342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99560354-b972-4248-b57b-0d05835a2f34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:14.162579 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.162503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbcgv\" (UniqueName: \"kubernetes.io/projected/99560354-b972-4248-b57b-0d05835a2f34-kube-api-access-vbcgv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:14.162731 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.162713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99560354-b972-4248-b57b-0d05835a2f34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:14.180968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.180937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbcgv\" (UniqueName: \"kubernetes.io/projected/99560354-b972-4248-b57b-0d05835a2f34-kube-api-access-vbcgv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:14.195849 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.195823    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:14.486565 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:14.486540    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"]
Sep 10 19:29:14.489636 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:29:14.489609    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99560354_b972_4248_b57b_0d05835a2f34.slice/crio-69631bf23c16e033848d74c46c7871d4491a5449edbba6e2cd799af9b1792a97 WatchSource:0}: Error finding container 69631bf23c16e033848d74c46c7871d4491a5449edbba6e2cd799af9b1792a97: Status 404 returned error can't find the container with id 69631bf23c16e033848d74c46c7871d4491a5449edbba6e2cd799af9b1792a97
Sep 10 19:29:15.017493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:15.017457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj" event={"ID":"99560354-b972-4248-b57b-0d05835a2f34","Type":"ContainerStarted","Data":"69631bf23c16e033848d74c46c7871d4491a5449edbba6e2cd799af9b1792a97"}
Sep 10 19:29:16.309654 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.309618    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8ft9z"]
Sep 10 19:29:16.319324 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.319296    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z"
Sep 10 19:29:16.324367 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.324233    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zvrvq\""
Sep 10 19:29:16.330352 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.329889    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8ft9z"]
Sep 10 19:29:16.488083 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.488043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsw9v\" (UniqueName: \"kubernetes.io/projected/d30f7ed4-8d40-46ed-94a1-8e29f0711ac5-kube-api-access-xsw9v\") pod \"authorino-operator-76b478bd78-8ft9z\" (UID: \"d30f7ed4-8d40-46ed-94a1-8e29f0711ac5\") " pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z"
Sep 10 19:29:16.588691 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.588565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsw9v\" (UniqueName: \"kubernetes.io/projected/d30f7ed4-8d40-46ed-94a1-8e29f0711ac5-kube-api-access-xsw9v\") pod \"authorino-operator-76b478bd78-8ft9z\" (UID: \"d30f7ed4-8d40-46ed-94a1-8e29f0711ac5\") " pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z"
Sep 10 19:29:16.598029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.597997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsw9v\" (UniqueName: \"kubernetes.io/projected/d30f7ed4-8d40-46ed-94a1-8e29f0711ac5-kube-api-access-xsw9v\") pod \"authorino-operator-76b478bd78-8ft9z\" (UID: \"d30f7ed4-8d40-46ed-94a1-8e29f0711ac5\") " pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z"
Sep 10 19:29:16.635446 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:16.635171    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z"
Sep 10 19:29:17.015665 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:17.015637    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8ft9z"]
Sep 10 19:29:18.243139 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:29:18.243105    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30f7ed4_8d40_46ed_94a1_8e29f0711ac5.slice/crio-1cadd9c60014870db62d33f384e7cff84b79c5c670d6684f2078952d19e0ca5a WatchSource:0}: Error finding container 1cadd9c60014870db62d33f384e7cff84b79c5c670d6684f2078952d19e0ca5a: Status 404 returned error can't find the container with id 1cadd9c60014870db62d33f384e7cff84b79c5c670d6684f2078952d19e0ca5a
Sep 10 19:29:19.045952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:19.045917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z" event={"ID":"d30f7ed4-8d40-46ed-94a1-8e29f0711ac5","Type":"ContainerStarted","Data":"1cadd9c60014870db62d33f384e7cff84b79c5c670d6684f2078952d19e0ca5a"}
Sep 10 19:29:19.047725 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:19.047699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj" event={"ID":"99560354-b972-4248-b57b-0d05835a2f34","Type":"ContainerStarted","Data":"e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549"}
Sep 10 19:29:19.047876 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:19.047787    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:19.077213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:19.077150    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj" podStartSLOduration=2.254624322 podStartE2EDuration="6.07712522s" totalImagesPullingTime="3.822500898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:19.074068137 +0000 UTC m=+547.890677722" watchObservedRunningTime="2026-09-10 19:29:19.07712522 +0000 UTC m=+547.893734789"
Sep 10 19:29:20.630116 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.630081    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"]
Sep 10 19:29:20.633758 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.633736    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"
Sep 10 19:29:20.635941 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.635919    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 19:29:20.636104 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.636086    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2vq6c\""
Sep 10 19:29:20.647470 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.647446    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"]
Sep 10 19:29:20.831093 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.831059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqr5k\" (UniqueName: \"kubernetes.io/projected/80db617f-d4df-44ea-957d-7037fe66f837-kube-api-access-nqr5k\") pod \"dns-operator-controller-manager-7b84cd7c9c-htpjk\" (UID: \"80db617f-d4df-44ea-957d-7037fe66f837\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"
Sep 10 19:29:20.931619 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.931538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqr5k\" (UniqueName: \"kubernetes.io/projected/80db617f-d4df-44ea-957d-7037fe66f837-kube-api-access-nqr5k\") pod \"dns-operator-controller-manager-7b84cd7c9c-htpjk\" (UID: \"80db617f-d4df-44ea-957d-7037fe66f837\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"
Sep 10 19:29:20.947770 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:20.947742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqr5k\" (UniqueName: \"kubernetes.io/projected/80db617f-d4df-44ea-957d-7037fe66f837-kube-api-access-nqr5k\") pod \"dns-operator-controller-manager-7b84cd7c9c-htpjk\" (UID: \"80db617f-d4df-44ea-957d-7037fe66f837\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"
Sep 10 19:29:21.070827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:21.070790    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z" event={"ID":"d30f7ed4-8d40-46ed-94a1-8e29f0711ac5","Type":"ContainerStarted","Data":"cb24bdebd104bd34309422da722466ea56678f7f0dc41d5903595265af321838"}
Sep 10 19:29:21.070998 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:21.070872    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z"
Sep 10 19:29:21.094640 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:21.094587    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z" podStartSLOduration=3.344826757 podStartE2EDuration="5.094572961s" totalImagesPullingTime="1.749746204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:21.093638817 +0000 UTC m=+549.910248418" watchObservedRunningTime="2026-09-10 19:29:21.094572961 +0000 UTC m=+549.911182529"
Sep 10 19:29:21.243451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:21.243416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"
Sep 10 19:29:21.518665 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:21.518624    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"]
Sep 10 19:29:21.520214 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:29:21.520066    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80db617f_d4df_44ea_957d_7037fe66f837.slice/crio-1a3caeba7800d0fd359c22290d14f5328d4ef65748e3633cc7d51c7d6ef831e0 WatchSource:0}: Error finding container 1a3caeba7800d0fd359c22290d14f5328d4ef65748e3633cc7d51c7d6ef831e0: Status 404 returned error can't find the container with id 1a3caeba7800d0fd359c22290d14f5328d4ef65748e3633cc7d51c7d6ef831e0
Sep 10 19:29:22.077158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:22.077122    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk" event={"ID":"80db617f-d4df-44ea-957d-7037fe66f837","Type":"ContainerStarted","Data":"1a3caeba7800d0fd359c22290d14f5328d4ef65748e3633cc7d51c7d6ef831e0"}
Sep 10 19:29:24.089062 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:24.089027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk" event={"ID":"80db617f-d4df-44ea-957d-7037fe66f837","Type":"ContainerStarted","Data":"ca281501c5e931d011ff5b341fa827df190c06896a56607dce7d065a2561a57f"}
Sep 10 19:29:24.089572 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:24.089183    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"
Sep 10 19:29:24.107860 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:24.107510    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk" podStartSLOduration=2.599317079 podStartE2EDuration="4.107490742s" totalImagesPullingTime="1.508173663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:24.107270145 +0000 UTC m=+552.923879799" watchObservedRunningTime="2026-09-10 19:29:24.107490742 +0000 UTC m=+552.924100312"
Sep 10 19:29:30.059958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:30.059925    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:32.080206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.080173    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-8ft9z"
Sep 10 19:29:32.412255 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.412172    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"]
Sep 10 19:29:32.412436 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.412388    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj" podUID="99560354-b972-4248-b57b-0d05835a2f34" containerName="manager" containerID="cri-o://e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549" gracePeriod=2
Sep 10 19:29:32.418169 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.418144    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"]
Sep 10 19:29:32.452080 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.452049    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"]
Sep 10 19:29:32.452451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.452433    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99560354-b972-4248-b57b-0d05835a2f34" containerName="manager"
Sep 10 19:29:32.452451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.452452    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="99560354-b972-4248-b57b-0d05835a2f34" containerName="manager"
Sep 10 19:29:32.452562 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.452527    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="99560354-b972-4248-b57b-0d05835a2f34" containerName="manager"
Sep 10 19:29:32.454428 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.454406    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.473812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.473785    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"]
Sep 10 19:29:32.492462 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:29:32.492416    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" is forbidden: User \"system:node:ip-10-0-132-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-149.ec2.internal' and this object" podUID="99560354-b972-4248-b57b-0d05835a2f34" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:32.529039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.529011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5wj\" (UniqueName: \"kubernetes.io/projected/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-kube-api-access-4w5wj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gwff7\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.529092 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.529055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gwff7\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.630007 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.629970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gwff7\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.630175 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.630061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5wj\" (UniqueName: \"kubernetes.io/projected/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-kube-api-access-4w5wj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gwff7\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.630344 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.630320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gwff7\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.641489 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.641466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5wj\" (UniqueName: \"kubernetes.io/projected/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-kube-api-access-4w5wj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gwff7\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.657415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.657366    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:32.659275 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:29:32.659248    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" is forbidden: User \"system:node:ip-10-0-132-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-149.ec2.internal' and this object" podUID="99560354-b972-4248-b57b-0d05835a2f34" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:32.731204 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.731172    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbcgv\" (UniqueName: \"kubernetes.io/projected/99560354-b972-4248-b57b-0d05835a2f34-kube-api-access-vbcgv\") pod \"99560354-b972-4248-b57b-0d05835a2f34\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") "
Sep 10 19:29:32.731388 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.731247    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99560354-b972-4248-b57b-0d05835a2f34-extensions-socket-volume\") pod \"99560354-b972-4248-b57b-0d05835a2f34\" (UID: \"99560354-b972-4248-b57b-0d05835a2f34\") "
Sep 10 19:29:32.731729 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.731705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99560354-b972-4248-b57b-0d05835a2f34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "99560354-b972-4248-b57b-0d05835a2f34" (UID: "99560354-b972-4248-b57b-0d05835a2f34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:32.733420 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.733392    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99560354-b972-4248-b57b-0d05835a2f34-kube-api-access-vbcgv" (OuterVolumeSpecName: "kube-api-access-vbcgv") pod "99560354-b972-4248-b57b-0d05835a2f34" (UID: "99560354-b972-4248-b57b-0d05835a2f34"). InnerVolumeSpecName "kube-api-access-vbcgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:29:32.781275 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.781241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:32.833185 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.831903    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbcgv\" (UniqueName: \"kubernetes.io/projected/99560354-b972-4248-b57b-0d05835a2f34-kube-api-access-vbcgv\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:32.833185 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:32.831936    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99560354-b972-4248-b57b-0d05835a2f34-extensions-socket-volume\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:33.063621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.063565    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"]
Sep 10 19:29:33.066352 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:29:33.066322    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b3b8ce_fe4b_4d59_8a61_f07806ce3bd2.slice/crio-a1d3d2987d1cc1730df93fc168d39ff43494674a782ee3549af5c144ee51ca2b WatchSource:0}: Error finding container a1d3d2987d1cc1730df93fc168d39ff43494674a782ee3549af5c144ee51ca2b: Status 404 returned error can't find the container with id a1d3d2987d1cc1730df93fc168d39ff43494674a782ee3549af5c144ee51ca2b
Sep 10 19:29:33.138518 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.138487    2558 generic.go:356] "Generic (PLEG): container finished" podID="99560354-b972-4248-b57b-0d05835a2f34" containerID="e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549" exitCode=0
Sep 10 19:29:33.138858 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.138535    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:33.138858 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.138583    2558 scope.go:117] "RemoveContainer" containerID="e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549"
Sep 10 19:29:33.140549 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:29:33.140521    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" is forbidden: User \"system:node:ip-10-0-132-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-149.ec2.internal' and this object" podUID="99560354-b972-4248-b57b-0d05835a2f34" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:33.140815 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.140678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7" event={"ID":"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2","Type":"ContainerStarted","Data":"09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c"}
Sep 10 19:29:33.140815 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.140722    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7" event={"ID":"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2","Type":"ContainerStarted","Data":"a1d3d2987d1cc1730df93fc168d39ff43494674a782ee3549af5c144ee51ca2b"}
Sep 10 19:29:33.140946 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.140831    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:33.142420 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:29:33.142395    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" is forbidden: User \"system:node:ip-10-0-132-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-149.ec2.internal' and this object" podUID="99560354-b972-4248-b57b-0d05835a2f34" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:33.148423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.148361    2558 scope.go:117] "RemoveContainer" containerID="e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549"
Sep 10 19:29:33.148810 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:29:33.148791    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549\": container with ID starting with e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549 not found: ID does not exist" containerID="e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549"
Sep 10 19:29:33.148879 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.148818    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549"} err="failed to get container status \"e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549\": rpc error: code = NotFound desc = could not find container \"e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549\": container with ID starting with e9ece055b5bb4dd353478d3b343bab04ec963a6a71b43eea514952998c9fd549 not found: ID does not exist"
Sep 10 19:29:33.171804 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.171748    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7" podStartSLOduration=1.17173036 podStartE2EDuration="1.17173036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:33.168875507 +0000 UTC m=+561.985485074" watchObservedRunningTime="2026-09-10 19:29:33.17173036 +0000 UTC m=+561.988339927"
Sep 10 19:29:33.177454 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:29:33.177423    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-t4kbj\" is forbidden: User \"system:node:ip-10-0-132-149.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-149.ec2.internal' and this object" podUID="99560354-b972-4248-b57b-0d05835a2f34" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4kbj"
Sep 10 19:29:33.656104 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:33.656067    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99560354-b972-4248-b57b-0d05835a2f34" path="/var/lib/kubelet/pods/99560354-b972-4248-b57b-0d05835a2f34/volumes"
Sep 10 19:29:34.063171 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.063131    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"]
Sep 10 19:29:34.066667 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.066644    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.079995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.079968    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"]
Sep 10 19:29:34.146113 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.146075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8shnv\" (UniqueName: \"kubernetes.io/projected/ef06d418-05ae-4e95-a14f-44de679566f9-kube-api-access-8shnv\") pod \"kuadrant-operator-controller-manager-5769f99d9f-blpzb\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.146560 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.146235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef06d418-05ae-4e95-a14f-44de679566f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-blpzb\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.246723 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.246691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8shnv\" (UniqueName: \"kubernetes.io/projected/ef06d418-05ae-4e95-a14f-44de679566f9-kube-api-access-8shnv\") pod \"kuadrant-operator-controller-manager-5769f99d9f-blpzb\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.246911 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.246823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef06d418-05ae-4e95-a14f-44de679566f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-blpzb\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.247205 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.247182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef06d418-05ae-4e95-a14f-44de679566f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-blpzb\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.258824 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.258792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8shnv\" (UniqueName: \"kubernetes.io/projected/ef06d418-05ae-4e95-a14f-44de679566f9-kube-api-access-8shnv\") pod \"kuadrant-operator-controller-manager-5769f99d9f-blpzb\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.376881 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.376786    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:34.656524 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:34.656498    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"]
Sep 10 19:29:34.658303 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:29:34.658279    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef06d418_05ae_4e95_a14f_44de679566f9.slice/crio-f150172059a5e3929cf01e880c783c20ebc40a833a36407c382fe863a0cb1e1e WatchSource:0}: Error finding container f150172059a5e3929cf01e880c783c20ebc40a833a36407c382fe863a0cb1e1e: Status 404 returned error can't find the container with id f150172059a5e3929cf01e880c783c20ebc40a833a36407c382fe863a0cb1e1e
Sep 10 19:29:35.097017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:35.096983    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-htpjk"
Sep 10 19:29:35.154704 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:35.154656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb" event={"ID":"ef06d418-05ae-4e95-a14f-44de679566f9","Type":"ContainerStarted","Data":"caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07"}
Sep 10 19:29:35.155157 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:35.154720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb" event={"ID":"ef06d418-05ae-4e95-a14f-44de679566f9","Type":"ContainerStarted","Data":"f150172059a5e3929cf01e880c783c20ebc40a833a36407c382fe863a0cb1e1e"}
Sep 10 19:29:35.155157 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:35.154784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:35.179085 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:35.179031    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb" podStartSLOduration=1.1790113660000001 podStartE2EDuration="1.179011366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:29:35.17773408 +0000 UTC m=+563.994343670" watchObservedRunningTime="2026-09-10 19:29:35.179011366 +0000 UTC m=+563.995620931"
Sep 10 19:29:44.150272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:44.150234    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:46.162999 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.162959    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:29:46.223787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.223750    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"]
Sep 10 19:29:46.224002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.223961    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7" podUID="08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" containerName="manager" containerID="cri-o://09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c" gracePeriod=10
Sep 10 19:29:46.476513 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.476486    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:46.557250 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.557220    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w5wj\" (UniqueName: \"kubernetes.io/projected/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-kube-api-access-4w5wj\") pod \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") "
Sep 10 19:29:46.557460 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.557273    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-extensions-socket-volume\") pod \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\" (UID: \"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2\") "
Sep 10 19:29:46.557733 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.557707    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" (UID: "08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:29:46.559232 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.559203    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-kube-api-access-4w5wj" (OuterVolumeSpecName: "kube-api-access-4w5wj") pod "08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" (UID: "08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2"). InnerVolumeSpecName "kube-api-access-4w5wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:29:46.658786 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.658747    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w5wj\" (UniqueName: \"kubernetes.io/projected/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-kube-api-access-4w5wj\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:46.658786 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:46.658780    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2-extensions-socket-volume\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:29:47.219968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.219929    2558 generic.go:356] "Generic (PLEG): container finished" podID="08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" containerID="09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c" exitCode=0
Sep 10 19:29:47.220360 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.219971    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"
Sep 10 19:29:47.220360 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.220010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7" event={"ID":"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2","Type":"ContainerDied","Data":"09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c"}
Sep 10 19:29:47.220360 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.220064    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7" event={"ID":"08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2","Type":"ContainerDied","Data":"a1d3d2987d1cc1730df93fc168d39ff43494674a782ee3549af5c144ee51ca2b"}
Sep 10 19:29:47.220360 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.220092    2558 scope.go:117] "RemoveContainer" containerID="09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c"
Sep 10 19:29:47.229681 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.229474    2558 scope.go:117] "RemoveContainer" containerID="09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c"
Sep 10 19:29:47.229817 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:29:47.229798    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c\": container with ID starting with 09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c not found: ID does not exist" containerID="09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c"
Sep 10 19:29:47.229863 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.229826    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c"} err="failed to get container status \"09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c\": rpc error: code = NotFound desc = could not find container \"09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c\": container with ID starting with 09ddc099cb13a29f4a50825742ffef73828bc8a5f08c9a7ec75ec025c4187c9c not found: ID does not exist"
Sep 10 19:29:47.252552 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.252521    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"]
Sep 10 19:29:47.261182 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.261155    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gwff7"]
Sep 10 19:29:47.655114 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:29:47.655036    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" path="/var/lib/kubelet/pods/08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2/volumes"
Sep 10 19:30:05.012160 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.012118    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5t227"]
Sep 10 19:30:05.012775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.012630    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" containerName="manager"
Sep 10 19:30:05.012775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.012651    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" containerName="manager"
Sep 10 19:30:05.012775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.012765    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b3b8ce-fe4b-4d59-8a61-f07806ce3bd2" containerName="manager"
Sep 10 19:30:05.015935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.015909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.018793 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.018743    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 19:30:05.018933 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.018905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcq6m\" (UniqueName: \"kubernetes.io/projected/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-kube-api-access-lcq6m\") pod \"limitador-limitador-8588749977-5t227\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") " pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.018999 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.018987    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-66xb2\""
Sep 10 19:30:05.019073 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.019055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-config-file\") pod \"limitador-limitador-8588749977-5t227\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") " pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.033740 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.033708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5t227"]
Sep 10 19:30:05.112088 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.112055    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5t227"]
Sep 10 19:30:05.119679 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.119647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-config-file\") pod \"limitador-limitador-8588749977-5t227\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") " pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.119837 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.119698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcq6m\" (UniqueName: \"kubernetes.io/projected/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-kube-api-access-lcq6m\") pod \"limitador-limitador-8588749977-5t227\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") " pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.120291 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.120267    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-config-file\") pod \"limitador-limitador-8588749977-5t227\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") " pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.133749 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.133728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcq6m\" (UniqueName: \"kubernetes.io/projected/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-kube-api-access-lcq6m\") pod \"limitador-limitador-8588749977-5t227\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") " pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.327870 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.327784    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:05.603203 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:05.603177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5t227"]
Sep 10 19:30:05.604911 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:30:05.604886    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984b73c3_efe9_4aa3_b9a7_8c9fd506b4ec.slice/crio-eb698fb9b0c6499b3706acd485bfddb219b6ba33d6abae54c6e5b9c1091f2eb0 WatchSource:0}: Error finding container eb698fb9b0c6499b3706acd485bfddb219b6ba33d6abae54c6e5b9c1091f2eb0: Status 404 returned error can't find the container with id eb698fb9b0c6499b3706acd485bfddb219b6ba33d6abae54c6e5b9c1091f2eb0
Sep 10 19:30:06.328529 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:06.328488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5t227" event={"ID":"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec","Type":"ContainerStarted","Data":"eb698fb9b0c6499b3706acd485bfddb219b6ba33d6abae54c6e5b9c1091f2eb0"}
Sep 10 19:30:08.341734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:08.341694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5t227" event={"ID":"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec","Type":"ContainerStarted","Data":"512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650"}
Sep 10 19:30:08.342098 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:08.341763    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:08.360523 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:08.360478    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5t227" podStartSLOduration=2.237872339 podStartE2EDuration="4.360463568s" totalImagesPullingTime="2.122591229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:30:08.359010055 +0000 UTC m=+597.175619635" watchObservedRunningTime="2026-09-10 19:30:08.360463568 +0000 UTC m=+597.177073135"
Sep 10 19:30:19.349327 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:19.349296    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:27.656730 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:27.656699    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5t227"]
Sep 10 19:30:27.657121 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:27.656872    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5t227" podUID="984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" containerName="limitador" containerID="cri-o://512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650" gracePeriod=30
Sep 10 19:30:28.203537 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.203506    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:28.317911 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.317820    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-config-file\") pod \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") "
Sep 10 19:30:28.317911 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.317859    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcq6m\" (UniqueName: \"kubernetes.io/projected/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-kube-api-access-lcq6m\") pod \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\" (UID: \"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec\") "
Sep 10 19:30:28.318170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.318146    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-config-file" (OuterVolumeSpecName: "config-file") pod "984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" (UID: "984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:30:28.319959 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.319928    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-kube-api-access-lcq6m" (OuterVolumeSpecName: "kube-api-access-lcq6m") pod "984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" (UID: "984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec"). InnerVolumeSpecName "kube-api-access-lcq6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:30:28.419213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.419178    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-config-file\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:30:28.419213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.419207    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcq6m\" (UniqueName: \"kubernetes.io/projected/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec-kube-api-access-lcq6m\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:30:28.446242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.446208    2558 generic.go:356] "Generic (PLEG): container finished" podID="984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" containerID="512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650" exitCode=0
Sep 10 19:30:28.446436 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.446249    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5t227"
Sep 10 19:30:28.446436 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.446259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5t227" event={"ID":"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec","Type":"ContainerDied","Data":"512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650"}
Sep 10 19:30:28.446436 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.446340    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5t227" event={"ID":"984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec","Type":"ContainerDied","Data":"eb698fb9b0c6499b3706acd485bfddb219b6ba33d6abae54c6e5b9c1091f2eb0"}
Sep 10 19:30:28.446436 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.446389    2558 scope.go:117] "RemoveContainer" containerID="512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650"
Sep 10 19:30:28.455190 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.455170    2558 scope.go:117] "RemoveContainer" containerID="512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650"
Sep 10 19:30:28.455474 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:30:28.455456    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650\": container with ID starting with 512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650 not found: ID does not exist" containerID="512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650"
Sep 10 19:30:28.455522 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.455483    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650"} err="failed to get container status \"512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650\": rpc error: code = NotFound desc = could not find container \"512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650\": container with ID starting with 512c6adec3b814908de23b993aa9fd62e6d3a68d53962149b96d1385f131d650 not found: ID does not exist"
Sep 10 19:30:28.467781 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.467757    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5t227"]
Sep 10 19:30:28.471978 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:28.471958    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5t227"]
Sep 10 19:30:29.654994 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:29.654964    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" path="/var/lib/kubelet/pods/984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec/volumes"
Sep 10 19:30:31.842827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.842795    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"]
Sep 10 19:30:31.843200 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.843134    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" containerName="limitador"
Sep 10 19:30:31.843200 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.843145    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" containerName="limitador"
Sep 10 19:30:31.843281 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.843203    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="984b73c3-efe9-4aa3-b9a7-8c9fd506b4ec" containerName="limitador"
Sep 10 19:30:31.846169 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.846141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:31.848473 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.848440    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 19:30:31.848671 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.848649    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-scj4v\""
Sep 10 19:30:31.849235 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.849188    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 19:30:31.849369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.849337    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 19:30:31.857223 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.857198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"]
Sep 10 19:30:31.952010 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.951957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e1f8bd21-3771-4145-8d34-870f7e947e68-data\") pod \"postgres-69fb4594cf-hmblr\" (UID: \"e1f8bd21-3771-4145-8d34-870f7e947e68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:31.952010 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:31.952002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxlq\" (UniqueName: \"kubernetes.io/projected/e1f8bd21-3771-4145-8d34-870f7e947e68-kube-api-access-6fxlq\") pod \"postgres-69fb4594cf-hmblr\" (UID: \"e1f8bd21-3771-4145-8d34-870f7e947e68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:32.052982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:32.052941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxlq\" (UniqueName: \"kubernetes.io/projected/e1f8bd21-3771-4145-8d34-870f7e947e68-kube-api-access-6fxlq\") pod \"postgres-69fb4594cf-hmblr\" (UID: \"e1f8bd21-3771-4145-8d34-870f7e947e68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:32.053175 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:32.053059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e1f8bd21-3771-4145-8d34-870f7e947e68-data\") pod \"postgres-69fb4594cf-hmblr\" (UID: \"e1f8bd21-3771-4145-8d34-870f7e947e68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:32.053473 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:32.053451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e1f8bd21-3771-4145-8d34-870f7e947e68-data\") pod \"postgres-69fb4594cf-hmblr\" (UID: \"e1f8bd21-3771-4145-8d34-870f7e947e68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:32.060978 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:32.060951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxlq\" (UniqueName: \"kubernetes.io/projected/e1f8bd21-3771-4145-8d34-870f7e947e68-kube-api-access-6fxlq\") pod \"postgres-69fb4594cf-hmblr\" (UID: \"e1f8bd21-3771-4145-8d34-870f7e947e68\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:32.157724 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:32.157631    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:32.433899 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:32.433875    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"]
Sep 10 19:30:32.436303 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:30:32.436275    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f8bd21_3771_4145_8d34_870f7e947e68.slice/crio-4c2f7064cf7fbe2f6598549328bd8aa0392497c3d4802a45a27325f4182aa248 WatchSource:0}: Error finding container 4c2f7064cf7fbe2f6598549328bd8aa0392497c3d4802a45a27325f4182aa248: Status 404 returned error can't find the container with id 4c2f7064cf7fbe2f6598549328bd8aa0392497c3d4802a45a27325f4182aa248
Sep 10 19:30:32.475938 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:32.475904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr" event={"ID":"e1f8bd21-3771-4145-8d34-870f7e947e68","Type":"ContainerStarted","Data":"4c2f7064cf7fbe2f6598549328bd8aa0392497c3d4802a45a27325f4182aa248"}
Sep 10 19:30:37.512427 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:37.512368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr" event={"ID":"e1f8bd21-3771-4145-8d34-870f7e947e68","Type":"ContainerStarted","Data":"d08402021e64b606b44d1659d87d8db24e4758d42f1e36e58b7ec3d18eb9b26e"}
Sep 10 19:30:37.512847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:37.512543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:37.531272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:37.531220    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr" podStartSLOduration=1.8062711280000001 podStartE2EDuration="6.531203274s" totalImagesPullingTime="4.724932146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:30:37.528745666 +0000 UTC m=+626.345355233" watchObservedRunningTime="2026-09-10 19:30:37.531203274 +0000 UTC m=+626.347812842"
Sep 10 19:30:43.547108 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:43.547081    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hmblr"
Sep 10 19:30:51.794633 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.794597    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-7r2js"]
Sep 10 19:30:51.814859 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.814829    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-7r2js"]
Sep 10 19:30:51.814998 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.814950    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.817352 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.817323    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 19:30:51.817505 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.817364    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 19:30:51.818135 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.818113    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 19:30:51.818277 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.818216    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6znfw\""
Sep 10 19:30:51.837004 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.836981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.837106 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.837031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-webhook-cert\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.837106 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.837057    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q27dx\" (UniqueName: \"kubernetes.io/projected/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-kube-api-access-q27dx\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.937497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.937463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-webhook-cert\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.937664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.937507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q27dx\" (UniqueName: \"kubernetes.io/projected/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-kube-api-access-q27dx\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.937664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.937551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.937664 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:30:51.937653    2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 19:30:51.937775 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:30:51.937716    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs podName:f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6 nodeName:}" failed. No retries permitted until 2026-09-10 19:30:52.43769629 +0000 UTC m=+641.254305838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs") pod "maas-controller-6c7dc64cb9-7r2js" (UID: "f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6") : secret "maas-controller-metrics-tls" not found
Sep 10 19:30:51.939869 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.939847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-webhook-cert\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.945739 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.945712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q27dx\" (UniqueName: \"kubernetes.io/projected/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-kube-api-access-q27dx\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:51.977784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.977747    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79fcf5569f-v29nl"]
Sep 10 19:30:51.980480 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.980456    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:51.990975 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:51.990950    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-v29nl"]
Sep 10 19:30:52.038704 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.038667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-webhook-cert\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.038883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.038750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.038883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.038784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtpx\" (UniqueName: \"kubernetes.io/projected/8d9d7211-e594-4051-a529-64893809fdf8-kube-api-access-6rtpx\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.139787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.139699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-webhook-cert\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.139787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.139758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.139787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.139783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtpx\" (UniqueName: \"kubernetes.io/projected/8d9d7211-e594-4051-a529-64893809fdf8-kube-api-access-6rtpx\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.139990 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:30:52.139908    2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 19:30:52.139990 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:30:52.139968    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs podName:8d9d7211-e594-4051-a529-64893809fdf8 nodeName:}" failed. No retries permitted until 2026-09-10 19:30:52.639953041 +0000 UTC m=+641.456562592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs") pod "maas-controller-79fcf5569f-v29nl" (UID: "8d9d7211-e594-4051-a529-64893809fdf8") : secret "maas-controller-metrics-tls" not found
Sep 10 19:30:52.142149 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.142120    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-webhook-cert\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.148059 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.148034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtpx\" (UniqueName: \"kubernetes.io/projected/8d9d7211-e594-4051-a529-64893809fdf8-kube-api-access-6rtpx\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.442874 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.442848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:52.445754 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.445726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs\") pod \"maas-controller-6c7dc64cb9-7r2js\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") " pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:52.644390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.644351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.646708 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.646688    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs\") pod \"maas-controller-79fcf5569f-v29nl\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") " pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.726574 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.726492    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:52.891094 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.891063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:52.995126 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:52.995100    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-7r2js"]
Sep 10 19:30:52.996682 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:30:52.996656    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f8bd73_5524_4ee5_a9cf_b6ef13d6b4f6.slice/crio-7befa94b9fad7ceeea9cbe8e8391c95cc37f265d277cfc599dbe2fb112a48c0b WatchSource:0}: Error finding container 7befa94b9fad7ceeea9cbe8e8391c95cc37f265d277cfc599dbe2fb112a48c0b: Status 404 returned error can't find the container with id 7befa94b9fad7ceeea9cbe8e8391c95cc37f265d277cfc599dbe2fb112a48c0b
Sep 10 19:30:53.160892 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:53.160869    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-v29nl"]
Sep 10 19:30:53.162931 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:30:53.162904    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9d7211_e594_4051_a529_64893809fdf8.slice/crio-5048025266b7235cb0c28fef3802817cd19e4538b324b12f9832928de943260c WatchSource:0}: Error finding container 5048025266b7235cb0c28fef3802817cd19e4538b324b12f9832928de943260c: Status 404 returned error can't find the container with id 5048025266b7235cb0c28fef3802817cd19e4538b324b12f9832928de943260c
Sep 10 19:30:53.598670 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:53.598638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-v29nl" event={"ID":"8d9d7211-e594-4051-a529-64893809fdf8","Type":"ContainerStarted","Data":"5048025266b7235cb0c28fef3802817cd19e4538b324b12f9832928de943260c"}
Sep 10 19:30:53.599681 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:53.599661    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js" event={"ID":"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6","Type":"ContainerStarted","Data":"7befa94b9fad7ceeea9cbe8e8391c95cc37f265d277cfc599dbe2fb112a48c0b"}
Sep 10 19:30:56.619956 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:56.619917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-v29nl" event={"ID":"8d9d7211-e594-4051-a529-64893809fdf8","Type":"ContainerStarted","Data":"51f9f1957ad12c5b5e1d9f7f7851ccddc65422e225f8ffe3a29077ea5b4826fb"}
Sep 10 19:30:56.620396 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:56.620104    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:30:56.621606 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:56.621581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js" event={"ID":"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6","Type":"ContainerStarted","Data":"cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca"}
Sep 10 19:30:56.621732 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:56.621715    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:30:56.639664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:56.639623    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79fcf5569f-v29nl" podStartSLOduration=3.115329241 podStartE2EDuration="5.639609707s" totalImagesPullingTime="2.524280466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:30:56.637708178 +0000 UTC m=+645.454317763" watchObservedRunningTime="2026-09-10 19:30:56.639609707 +0000 UTC m=+645.456219334"
Sep 10 19:30:56.663138 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:30:56.663082    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js" podStartSLOduration=2.982187874 podStartE2EDuration="5.663063192s" totalImagesPullingTime="2.680875318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:30:56.660321357 +0000 UTC m=+645.476930948" watchObservedRunningTime="2026-09-10 19:30:56.663063192 +0000 UTC m=+645.479672762"
Sep 10 19:31:07.628910 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:07.628871    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:31:07.629347 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:07.628955    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:31:07.698933 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:07.698903    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-7r2js"]
Sep 10 19:31:07.699107 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:07.699082    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js" podUID="f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" containerName="manager" containerID="cri-o://cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca" gracePeriod=30
Sep 10 19:31:07.946734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:07.946703    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:31:08.091279 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.091242    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-webhook-cert\") pod \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") "
Sep 10 19:31:08.091481 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.091306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q27dx\" (UniqueName: \"kubernetes.io/projected/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-kube-api-access-q27dx\") pod \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") "
Sep 10 19:31:08.091481 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.091353    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs\") pod \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\" (UID: \"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6\") "
Sep 10 19:31:08.093636 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.093599    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" (UID: "f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:31:08.093636 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.093616    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" (UID: "f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:31:08.093815 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.093663    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-kube-api-access-q27dx" (OuterVolumeSpecName: "kube-api-access-q27dx") pod "f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" (UID: "f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6"). InnerVolumeSpecName "kube-api-access-q27dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:31:08.193110 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.193085    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-webhook-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:31:08.193110 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.193111    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q27dx\" (UniqueName: \"kubernetes.io/projected/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-kube-api-access-q27dx\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:31:08.193320 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.193120    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:31:08.686618 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.686528    2558 generic.go:356] "Generic (PLEG): container finished" podID="f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" containerID="cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca" exitCode=0
Sep 10 19:31:08.686618 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.686594    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js"
Sep 10 19:31:08.687230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.686614    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js" event={"ID":"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6","Type":"ContainerDied","Data":"cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca"}
Sep 10 19:31:08.687230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.686670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c7dc64cb9-7r2js" event={"ID":"f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6","Type":"ContainerDied","Data":"7befa94b9fad7ceeea9cbe8e8391c95cc37f265d277cfc599dbe2fb112a48c0b"}
Sep 10 19:31:08.687230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.686694    2558 scope.go:117] "RemoveContainer" containerID="cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca"
Sep 10 19:31:08.695795 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.695779    2558 scope.go:117] "RemoveContainer" containerID="cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca"
Sep 10 19:31:08.696053 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:31:08.696033    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca\": container with ID starting with cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca not found: ID does not exist" containerID="cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca"
Sep 10 19:31:08.696124 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.696061    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca"} err="failed to get container status \"cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca\": rpc error: code = NotFound desc = could not find container \"cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca\": container with ID starting with cb4e60ac5f4cbab985dff9c60aa01d8d1ba57bce5369caa7d5c30bf7430c5bca not found: ID does not exist"
Sep 10 19:31:08.708787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.708759    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-7r2js"]
Sep 10 19:31:08.712682 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:08.712659    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c7dc64cb9-7r2js"]
Sep 10 19:31:09.655271 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:09.655241    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" path="/var/lib/kubelet/pods/f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6/volumes"
Sep 10 19:31:29.289131 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.289096    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"]
Sep 10 19:31:29.289685 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.289663    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" containerName="manager"
Sep 10 19:31:29.289770 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.289688    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" containerName="manager"
Sep 10 19:31:29.289831 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.289819    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f8bd73-5524-4ee5-a9cf-b6ef13d6b4f6" containerName="manager"
Sep 10 19:31:29.294535 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.294513    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.297023 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.297002    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5cfmg\""
Sep 10 19:31:29.297768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.297748    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 19:31:29.297892 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.297781    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 19:31:29.308287 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.308261    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"]
Sep 10 19:31:29.380016 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.379983    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43f88d-862d-437e-bd2d-feebe237e4f9-openshift-service-ca\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.380161 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.380024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-maas-api-tls\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.380161 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.380123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2fv2\" (UniqueName: \"kubernetes.io/projected/ec43f88d-862d-437e-bd2d-feebe237e4f9-kube-api-access-h2fv2\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.380237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.380166    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-metrics-certs\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.481491 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.481455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-maas-api-tls\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.481650 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.481619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fv2\" (UniqueName: \"kubernetes.io/projected/ec43f88d-862d-437e-bd2d-feebe237e4f9-kube-api-access-h2fv2\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.481693 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.481665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-metrics-certs\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.481750 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.481734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43f88d-862d-437e-bd2d-feebe237e4f9-openshift-service-ca\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.482323 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.482301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43f88d-862d-437e-bd2d-feebe237e4f9-openshift-service-ca\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.484063 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.484022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-maas-api-tls\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.484207 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.484151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-metrics-certs\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.496578 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.496542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2fv2\" (UniqueName: \"kubernetes.io/projected/ec43f88d-862d-437e-bd2d-feebe237e4f9-kube-api-access-h2fv2\") pod \"maas-api-54b46465b9-qjj5x\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") " pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.604630 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.604519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:29.908357 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.908328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"]
Sep 10 19:31:29.910974 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:31:29.910945    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec43f88d_862d_437e_bd2d_feebe237e4f9.slice/crio-f6a73d434f510400c5a8b09191da863cd5d8c5eb5721ae39d7545789570d5a5d WatchSource:0}: Error finding container f6a73d434f510400c5a8b09191da863cd5d8c5eb5721ae39d7545789570d5a5d: Status 404 returned error can't find the container with id f6a73d434f510400c5a8b09191da863cd5d8c5eb5721ae39d7545789570d5a5d
Sep 10 19:31:29.912442 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:29.912423    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:31:30.045523 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.045489    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-s46mh"]
Sep 10 19:31:30.048677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.048656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.051569 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.051550    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-27clf\""
Sep 10 19:31:30.051745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.051724    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 19:31:30.065894 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.065870    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-s46mh"]
Sep 10 19:31:30.087208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.087170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nks6x\" (UniqueName: \"kubernetes.io/projected/256a7d14-aadc-43bd-b457-dc318fc6b539-kube-api-access-nks6x\") pod \"payload-processing-5b54b7fbb7-s46mh\" (UID: \"256a7d14-aadc-43bd-b457-dc318fc6b539\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.087401 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.087218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256a7d14-aadc-43bd-b457-dc318fc6b539-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-s46mh\" (UID: \"256a7d14-aadc-43bd-b457-dc318fc6b539\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.188453 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.188304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nks6x\" (UniqueName: \"kubernetes.io/projected/256a7d14-aadc-43bd-b457-dc318fc6b539-kube-api-access-nks6x\") pod \"payload-processing-5b54b7fbb7-s46mh\" (UID: \"256a7d14-aadc-43bd-b457-dc318fc6b539\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.188453 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.188368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256a7d14-aadc-43bd-b457-dc318fc6b539-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-s46mh\" (UID: \"256a7d14-aadc-43bd-b457-dc318fc6b539\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.189195 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.189176    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/256a7d14-aadc-43bd-b457-dc318fc6b539-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-s46mh\" (UID: \"256a7d14-aadc-43bd-b457-dc318fc6b539\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.203213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.203181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nks6x\" (UniqueName: \"kubernetes.io/projected/256a7d14-aadc-43bd-b457-dc318fc6b539-kube-api-access-nks6x\") pod \"payload-processing-5b54b7fbb7-s46mh\" (UID: \"256a7d14-aadc-43bd-b457-dc318fc6b539\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.360083 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.360045    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:30.658343 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:31:30.658304    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256a7d14_aadc_43bd_b457_dc318fc6b539.slice/crio-1e6dffbca4f564e200ba5eb7c1f24beecaf8ba5e0230742a49ea084ac0b0e3e8 WatchSource:0}: Error finding container 1e6dffbca4f564e200ba5eb7c1f24beecaf8ba5e0230742a49ea084ac0b0e3e8: Status 404 returned error can't find the container with id 1e6dffbca4f564e200ba5eb7c1f24beecaf8ba5e0230742a49ea084ac0b0e3e8
Sep 10 19:31:30.658672 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.658646    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-s46mh"]
Sep 10 19:31:30.808052 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.808011    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh" event={"ID":"256a7d14-aadc-43bd-b457-dc318fc6b539","Type":"ContainerStarted","Data":"1e6dffbca4f564e200ba5eb7c1f24beecaf8ba5e0230742a49ea084ac0b0e3e8"}
Sep 10 19:31:30.810570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:30.810540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x" event={"ID":"ec43f88d-862d-437e-bd2d-feebe237e4f9","Type":"ContainerStarted","Data":"f6a73d434f510400c5a8b09191da863cd5d8c5eb5721ae39d7545789570d5a5d"}
Sep 10 19:31:32.825300 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:32.825258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh" event={"ID":"256a7d14-aadc-43bd-b457-dc318fc6b539","Type":"ContainerStarted","Data":"1d2ca2cfa92212597dfe2e64d4f8b5871da157044e26eb76878c09353cefc630"}
Sep 10 19:31:32.825782 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:32.825400    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:32.826926 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:32.826901    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x" event={"ID":"ec43f88d-862d-437e-bd2d-feebe237e4f9","Type":"ContainerStarted","Data":"6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376"}
Sep 10 19:31:32.827068 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:32.826951    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:32.846223 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:32.846165    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh" podStartSLOduration=1.127533473 podStartE2EDuration="2.846148671s" totalImagesPullingTime="1.718615198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:32.843248445 +0000 UTC m=+681.659858036" watchObservedRunningTime="2026-09-10 19:31:32.846148671 +0000 UTC m=+681.662758239"
Sep 10 19:31:32.869929 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:32.869879    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x" podStartSLOduration=1.9863504189999999 podStartE2EDuration="3.869860927s" totalImagesPullingTime="1.883510508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:32.868579883 +0000 UTC m=+681.685189438" watchObservedRunningTime="2026-09-10 19:31:32.869860927 +0000 UTC m=+681.686470498"
Sep 10 19:31:38.837661 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:38.837633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:31:43.834662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:43.834629    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-s46mh"
Sep 10 19:31:50.990169 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:50.990108    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"]
Sep 10 19:31:50.994621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:50.994601    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:50.997481 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:50.997453    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 19:31:50.997600 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:50.997453    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xklpr\""
Sep 10 19:31:50.997600 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:50.997495    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 19:31:50.997600 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:50.997505    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 19:31:51.005325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.005302    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"]
Sep 10 19:31:51.079501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.079447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.079501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.079500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.079890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.079629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fksm\" (UniqueName: \"kubernetes.io/projected/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-kube-api-access-9fksm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.079890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.079674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.079890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.079698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.079890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.079745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181282 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181282 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fksm\" (UniqueName: \"kubernetes.io/projected/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-kube-api-access-9fksm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181607 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181607 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181607 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181607 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181903 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181885    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.181955 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.181923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.183698 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.183671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.183877 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.183858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.197901 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.197873    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fksm\" (UniqueName: \"kubernetes.io/projected/7f278e9a-bcaf-4b95-8804-36f3a8e6c748-kube-api-access-9fksm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr\" (UID: \"7f278e9a-bcaf-4b95-8804-36f3a8e6c748\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.305416 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.305314    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:31:51.580012 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.579983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"]
Sep 10 19:31:51.581494 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:31:51.581466    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f278e9a_bcaf_4b95_8804_36f3a8e6c748.slice/crio-1916768ac45b62fc21bae8e7566aef450aaa129d9bfd50796429e583bc97b447 WatchSource:0}: Error finding container 1916768ac45b62fc21bae8e7566aef450aaa129d9bfd50796429e583bc97b447: Status 404 returned error can't find the container with id 1916768ac45b62fc21bae8e7566aef450aaa129d9bfd50796429e583bc97b447
Sep 10 19:31:51.930899 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:51.930803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr" event={"ID":"7f278e9a-bcaf-4b95-8804-36f3a8e6c748","Type":"ContainerStarted","Data":"1916768ac45b62fc21bae8e7566aef450aaa129d9bfd50796429e583bc97b447"}
Sep 10 19:31:52.943295 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:52.943256    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr" event={"ID":"7f278e9a-bcaf-4b95-8804-36f3a8e6c748","Type":"ContainerStarted","Data":"d5e4271fcd2104ea8eae49b2d154a5b7ba132bfce5a7eb1fd1ed93f70a8718d3"}
Sep 10 19:31:52.964228 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:31:52.964165    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr" podStartSLOduration=1.777886893 podStartE2EDuration="2.964142761s" totalImagesPullingTime="1.186255868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:31:52.961777712 +0000 UTC m=+701.778387283" watchObservedRunningTime="2026-09-10 19:31:52.964142761 +0000 UTC m=+701.780752331"
Sep 10 19:32:01.305462 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:01.305415    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:32:01.305902 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:01.305543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:32:01.317848 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:01.317821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:32:02.003307 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.003278    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr"
Sep 10 19:32:02.173249 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.173203    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"]
Sep 10 19:32:02.177092 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.177070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.179197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.179177    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 19:32:02.187416 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.187393    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"]
Sep 10 19:32:02.278257 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.278163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7pmh\" (UniqueName: \"kubernetes.io/projected/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-kube-api-access-l7pmh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.278257 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.278213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.278257 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.278237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.278517 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.278281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.278517 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.278408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.278517 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.278477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.379453 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379417    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7pmh\" (UniqueName: \"kubernetes.io/projected/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-kube-api-access-l7pmh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.379453 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.379942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.379942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.379942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.379942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.380193 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.380193 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.379998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.380193 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.380053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.381861 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.381836    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.382190 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.382171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.388932 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.388913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7pmh\" (UniqueName: \"kubernetes.io/projected/cfc6905e-4b59-41a8-bdf8-dfb1575ac01a-kube-api-access-l7pmh\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn\" (UID: \"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.487746 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.487702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:02.760082 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.760055    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"]
Sep 10 19:32:02.761202 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:32:02.761175    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc6905e_4b59_41a8_bdf8_dfb1575ac01a.slice/crio-69c4809b605293819906b5ca71e341f07282c1f55dcf8e924f3e2432a751e0cc WatchSource:0}: Error finding container 69c4809b605293819906b5ca71e341f07282c1f55dcf8e924f3e2432a751e0cc: Status 404 returned error can't find the container with id 69c4809b605293819906b5ca71e341f07282c1f55dcf8e924f3e2432a751e0cc
Sep 10 19:32:02.998742 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:02.998704    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn" event={"ID":"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a","Type":"ContainerStarted","Data":"69c4809b605293819906b5ca71e341f07282c1f55dcf8e924f3e2432a751e0cc"}
Sep 10 19:32:04.008746 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:04.008650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn" event={"ID":"cfc6905e-4b59-41a8-bdf8-dfb1575ac01a","Type":"ContainerStarted","Data":"82480e264ae01f5f246d6d3b3245e4cfd1b99ce0170f0f1bdc8542da90c41140"}
Sep 10 19:32:04.025925 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:04.025866    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn" podStartSLOduration=1.7805484900000002 podStartE2EDuration="2.025847848s" totalImagesPullingTime="245.299358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:32:04.024450861 +0000 UTC m=+712.841060461" watchObservedRunningTime="2026-09-10 19:32:04.025847848 +0000 UTC m=+712.842457447"
Sep 10 19:32:12.488112 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:12.488052    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:12.488764 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:12.488136    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:12.500708 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:12.500686    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:32:13.067754 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:32:13.067726    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn"
Sep 10 19:34:23.526500 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.526465    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"]
Sep 10 19:34:23.528937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.528915    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.531415 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.531389    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-3a1590-serving-cert\""
Sep 10 19:34:23.542839 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.542811    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"]
Sep 10 19:34:23.660877 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.660848    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-metrics-certs\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.661055 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.660882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhr9\" (UniqueName: \"kubernetes.io/projected/deb4c736-8899-4c78-a92f-00d30433c276-kube-api-access-rnhr9\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.661055 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.660915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deb4c736-8899-4c78-a92f-00d30433c276-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.661055 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.660995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-maas-api-tls\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.761656 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.761621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhr9\" (UniqueName: \"kubernetes.io/projected/deb4c736-8899-4c78-a92f-00d30433c276-kube-api-access-rnhr9\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.761865 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.761837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deb4c736-8899-4c78-a92f-00d30433c276-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.762024 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.761933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-maas-api-tls\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.762165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.762131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-metrics-certs\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.762599 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.762578    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deb4c736-8899-4c78-a92f-00d30433c276-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.764352 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.764329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-metrics-certs\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.764448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.764413    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-maas-api-tls\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.769747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.769723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhr9\" (UniqueName: \"kubernetes.io/projected/deb4c736-8899-4c78-a92f-00d30433c276-kube-api-access-rnhr9\") pod \"maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:23.841219 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:23.841136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:24.117674 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:24.117639    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"]
Sep 10 19:34:24.120066 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:34:24.120040    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb4c736_8899_4c78_a92f_00d30433c276.slice/crio-3a9b5282aa689a2378ae8bb3ef32bda4162b17cab804fa61e82045ac6a827e3e WatchSource:0}: Error finding container 3a9b5282aa689a2378ae8bb3ef32bda4162b17cab804fa61e82045ac6a827e3e: Status 404 returned error can't find the container with id 3a9b5282aa689a2378ae8bb3ef32bda4162b17cab804fa61e82045ac6a827e3e
Sep 10 19:34:24.783780 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:24.783734    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5" event={"ID":"deb4c736-8899-4c78-a92f-00d30433c276","Type":"ContainerStarted","Data":"b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb"}
Sep 10 19:34:24.784164 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:24.783801    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5" event={"ID":"deb4c736-8899-4c78-a92f-00d30433c276","Type":"ContainerStarted","Data":"3a9b5282aa689a2378ae8bb3ef32bda4162b17cab804fa61e82045ac6a827e3e"}
Sep 10 19:34:24.784164 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:24.783926    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:24.804161 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:24.804103    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5" podStartSLOduration=1.3614588859999999 podStartE2EDuration="1.804086043s" totalImagesPullingTime="442.627157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:34:24.802110945 +0000 UTC m=+853.618720534" watchObservedRunningTime="2026-09-10 19:34:24.804086043 +0000 UTC m=+853.620695690"
Sep 10 19:34:27.879661 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.879627    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"]
Sep 10 19:34:27.882205 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.882185    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.884992 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.884971    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f7189cc9-openshift-default-dockercfg-zr7dg\""
Sep 10 19:34:27.894727 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istiod-ca-cert\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894818 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894735    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-socket\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894818 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-certs\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894901 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-data\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894901 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-token\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894901 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqk7t\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-kube-api-access-mqk7t\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894996 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-credential-socket\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894996 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-podinfo\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.894996 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.894946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-envoy\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.918791 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.918761    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"]
Sep 10 19:34:27.996269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-data\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-token\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqk7t\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-kube-api-access-mqk7t\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-credential-socket\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-podinfo\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-envoy\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istiod-ca-cert\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996498    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-socket\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-certs\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996912 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996790    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-data\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996912 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-credential-socket\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.996912 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-socket\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.997021 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.996923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-certs\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.997200 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.997179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istiod-ca-cert\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.998786 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.998766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-envoy\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:27.998959 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:27.998937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-podinfo\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:28.011086 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:28.011061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-token\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:28.012590 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:28.012569    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqk7t\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-kube-api-access-mqk7t\") pod \"e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") " pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:28.193468 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:28.193434    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:28.514047 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:28.513982    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"]
Sep 10 19:34:28.516684 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:34:28.516657    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9498b0ca_9d6c_4e44_9e81_4edda84068ed.slice/crio-4a21db930c9b3981796044248606cefeda64e1fde053696a2933caa6607ccd2f WatchSource:0}: Error finding container 4a21db930c9b3981796044248606cefeda64e1fde053696a2933caa6607ccd2f: Status 404 returned error can't find the container with id 4a21db930c9b3981796044248606cefeda64e1fde053696a2933caa6607ccd2f
Sep 10 19:34:28.814361 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:28.814274    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" event={"ID":"9498b0ca-9d6c-4e44-9e81-4edda84068ed","Type":"ContainerStarted","Data":"4a21db930c9b3981796044248606cefeda64e1fde053696a2933caa6607ccd2f"}
Sep 10 19:34:30.802314 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:30.802284    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:34:31.199862 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:31.199825    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:34:31.199956 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:31.199897    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:34:31.199956 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:31.199926    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:34:31.833845 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:31.833804    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" event={"ID":"9498b0ca-9d6c-4e44-9e81-4edda84068ed","Type":"ContainerStarted","Data":"17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2"}
Sep 10 19:34:31.865175 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:31.865123    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podStartSLOduration=2.184294816 podStartE2EDuration="4.865107025s" totalImagesPullingTime="2.680812209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:34:31.863204561 +0000 UTC m=+860.679814148" watchObservedRunningTime="2026-09-10 19:34:31.865107025 +0000 UTC m=+860.681716593"
Sep 10 19:34:32.194237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:32.194203    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:32.199289 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:32.199260    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:32.839814 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:32.839787    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:32.840922 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:32.840903    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:34.531937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.531902    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"]
Sep 10 19:34:34.534493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.534474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.537937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.537914    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f7189cc9-serving-cert\""
Sep 10 19:34:34.558688 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.558659    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"]
Sep 10 19:34:34.568032 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.568007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-metrics-certs\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.568170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.568050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.568170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.568096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-openshift-service-ca\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.568170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.568125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n99n\" (UniqueName: \"kubernetes.io/projected/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-kube-api-access-9n99n\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.669506 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.669473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-metrics-certs\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.669665 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.669531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.669665 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.669578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-openshift-service-ca\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.669665 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.669627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n99n\" (UniqueName: \"kubernetes.io/projected/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-kube-api-access-9n99n\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.669833 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:34.669682    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-serving-cert: secret "maas-api-e2e-ait-f7189cc9-serving-cert" not found
Sep 10 19:34:34.669833 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:34.669739    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls podName:d3582127-c813-4a7e-9cf9-b15e04a6f9b6 nodeName:}" failed. No retries permitted until 2026-09-10 19:34:35.169721462 +0000 UTC m=+863.986331013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls") pod "maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7" (UID: "d3582127-c813-4a7e-9cf9-b15e04a6f9b6") : secret "maas-api-e2e-ait-f7189cc9-serving-cert" not found
Sep 10 19:34:34.670313 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.670289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-openshift-service-ca\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.671958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.671938    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-metrics-certs\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:34.684999 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:34.684980    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n99n\" (UniqueName: \"kubernetes.io/projected/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-kube-api-access-9n99n\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:35.174499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.174466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:35.176992 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.176965    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls\") pod \"maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:35.446505 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.446461    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:35.606017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.605981    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"]
Sep 10 19:34:35.609824 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.609801    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.612340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.612316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-18c3c3-serving-cert\""
Sep 10 19:34:35.625358 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.625334    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"]
Sep 10 19:34:35.679252 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.679215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxj89\" (UniqueName: \"kubernetes.io/projected/20eceaaf-f020-440b-98e5-2e42765a63e2-kube-api-access-mxj89\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.679429 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.679268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20eceaaf-f020-440b-98e5-2e42765a63e2-openshift-service-ca\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.679429 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.679320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-metrics-certs\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.679429 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.679349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.726211 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.726177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"]
Sep 10 19:34:35.728699 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:34:35.728672    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3582127_c813_4a7e_9cf9_b15e04a6f9b6.slice/crio-e53fadbd2bcb92e6fae12b8d2220d1ed8ca2f494221efb7d4815555d3771bbc4 WatchSource:0}: Error finding container e53fadbd2bcb92e6fae12b8d2220d1ed8ca2f494221efb7d4815555d3771bbc4: Status 404 returned error can't find the container with id e53fadbd2bcb92e6fae12b8d2220d1ed8ca2f494221efb7d4815555d3771bbc4
Sep 10 19:34:35.780816 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.780784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxj89\" (UniqueName: \"kubernetes.io/projected/20eceaaf-f020-440b-98e5-2e42765a63e2-kube-api-access-mxj89\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.780978 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.780830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20eceaaf-f020-440b-98e5-2e42765a63e2-openshift-service-ca\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.781039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.780978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-metrics-certs\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.781039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.781015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.781182 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:35.781155    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-serving-cert: secret "maas-api-e2e-autores-18c3c3-serving-cert" not found
Sep 10 19:34:35.781247 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:35.781237    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls podName:20eceaaf-f020-440b-98e5-2e42765a63e2 nodeName:}" failed. No retries permitted until 2026-09-10 19:34:36.281215954 +0000 UTC m=+865.097825504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls") pod "maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" (UID: "20eceaaf-f020-440b-98e5-2e42765a63e2") : secret "maas-api-e2e-autores-18c3c3-serving-cert" not found
Sep 10 19:34:35.781547 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.781529    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20eceaaf-f020-440b-98e5-2e42765a63e2-openshift-service-ca\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.783390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.783357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-metrics-certs\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.789714 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.789690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxj89\" (UniqueName: \"kubernetes.io/projected/20eceaaf-f020-440b-98e5-2e42765a63e2-kube-api-access-mxj89\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:35.857494 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:35.857463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7" event={"ID":"d3582127-c813-4a7e-9cf9-b15e04a6f9b6","Type":"ContainerStarted","Data":"e53fadbd2bcb92e6fae12b8d2220d1ed8ca2f494221efb7d4815555d3771bbc4"}
Sep 10 19:34:36.286623 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:36.286590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:36.286820 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:36.286752    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-serving-cert: secret "maas-api-e2e-autores-18c3c3-serving-cert" not found
Sep 10 19:34:36.286820 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:36.286815    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls podName:20eceaaf-f020-440b-98e5-2e42765a63e2 nodeName:}" failed. No retries permitted until 2026-09-10 19:34:37.286798224 +0000 UTC m=+866.103407781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls") pod "maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" (UID: "20eceaaf-f020-440b-98e5-2e42765a63e2") : secret "maas-api-e2e-autores-18c3c3-serving-cert" not found
Sep 10 19:34:36.865203 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:36.865161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7" event={"ID":"d3582127-c813-4a7e-9cf9-b15e04a6f9b6","Type":"ContainerStarted","Data":"444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f"}
Sep 10 19:34:36.865661 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:36.865237    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:36.887009 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:36.886952    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7" podStartSLOduration=2.453361275 podStartE2EDuration="2.886935695s" totalImagesPullingTime="433.57442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:34:36.884888757 +0000 UTC m=+865.701498346" watchObservedRunningTime="2026-09-10 19:34:36.886935695 +0000 UTC m=+865.703545263"
Sep 10 19:34:37.298825 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:37.298783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:37.301253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:37.301224    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls\") pod \"maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:37.422511 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:37.422474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:37.696962 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:37.696939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"]
Sep 10 19:34:37.698853 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:34:37.698826    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20eceaaf_f020_440b_98e5_2e42765a63e2.slice/crio-beb6326564e959495a815483e797f7e298b8c73a45da7b0a2e1ba56429a5496e WatchSource:0}: Error finding container beb6326564e959495a815483e797f7e298b8c73a45da7b0a2e1ba56429a5496e: Status 404 returned error can't find the container with id beb6326564e959495a815483e797f7e298b8c73a45da7b0a2e1ba56429a5496e
Sep 10 19:34:37.872458 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:37.872405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" event={"ID":"20eceaaf-f020-440b-98e5-2e42765a63e2","Type":"ContainerStarted","Data":"beb6326564e959495a815483e797f7e298b8c73a45da7b0a2e1ba56429a5496e"}
Sep 10 19:34:38.879869 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:38.879836    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" event={"ID":"20eceaaf-f020-440b-98e5-2e42765a63e2","Type":"ContainerStarted","Data":"8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c"}
Sep 10 19:34:38.880273 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:38.879959    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:38.916971 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:38.916917    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" podStartSLOduration=3.51985387 podStartE2EDuration="3.916900588s" totalImagesPullingTime="397.046718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:34:38.913624114 +0000 UTC m=+867.730233700" watchObservedRunningTime="2026-09-10 19:34:38.916900588 +0000 UTC m=+867.733510156"
Sep 10 19:34:42.878279 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:42.878250    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:34:44.891718 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:44.891687    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:34:52.208617 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.208578    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"]
Sep 10 19:34:52.211217 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.211199    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.213936 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.213906    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a037c8-serving-cert\""
Sep 10 19:34:52.225937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.225908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"]
Sep 10 19:34:52.352180 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.352148    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.352355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.352186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-metrics-certs\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.352355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.352276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.352355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.352341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjfb\" (UniqueName: \"kubernetes.io/projected/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-kube-api-access-vmjfb\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.453131 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.453092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.453131 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.453131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-metrics-certs\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.453348 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:52.453236    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-serving-cert: secret "maas-api-e2e-inf-b-a037c8-serving-cert" not found
Sep 10 19:34:52.453348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.453260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.453348 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:34:52.453294    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls podName:3811db2d-0d5f-4fcb-ad90-163ebe3c0c72 nodeName:}" failed. No retries permitted until 2026-09-10 19:34:52.953278587 +0000 UTC m=+881.769888132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls") pod "maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq" (UID: "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72") : secret "maas-api-e2e-inf-b-a037c8-serving-cert" not found
Sep 10 19:34:52.453348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.453331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjfb\" (UniqueName: \"kubernetes.io/projected/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-kube-api-access-vmjfb\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.453908 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.453891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.455595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.455577    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-metrics-certs\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.462390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.462320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjfb\" (UniqueName: \"kubernetes.io/projected/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-kube-api-access-vmjfb\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.959443 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.959405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.961768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.961739    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls\") pod \"maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:52.994867 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.994836    2558 generic.go:356] "Generic (PLEG): container finished" podID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerID="17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2" exitCode=0
Sep 10 19:34:52.995018 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.994909    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" event={"ID":"9498b0ca-9d6c-4e44-9e81-4edda84068ed","Type":"ContainerDied","Data":"17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2"}
Sep 10 19:34:52.995324 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.995310    2558 scope.go:117] "RemoveContainer" containerID="17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2"
Sep 10 19:34:52.996445 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.996418    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:34:52.996516 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.996484    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:34:52.996554 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:52.996525    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:34:53.131727 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:53.130586    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:53.429222 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:53.429196    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"]
Sep 10 19:34:53.431202 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:34:53.431174    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3811db2d_0d5f_4fcb_ad90_163ebe3c0c72.slice/crio-c06d6d1d6b0078bb53cce0c00389ad43f9329b2063c4ba87af12a1906d0ce2de WatchSource:0}: Error finding container c06d6d1d6b0078bb53cce0c00389ad43f9329b2063c4ba87af12a1906d0ce2de: Status 404 returned error can't find the container with id c06d6d1d6b0078bb53cce0c00389ad43f9329b2063c4ba87af12a1906d0ce2de
Sep 10 19:34:54.004006 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.003914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" event={"ID":"9498b0ca-9d6c-4e44-9e81-4edda84068ed","Type":"ContainerStarted","Data":"ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7"}
Sep 10 19:34:54.006053 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.006020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq" event={"ID":"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72","Type":"ContainerStarted","Data":"13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2"}
Sep 10 19:34:54.006212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.006071    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq" event={"ID":"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72","Type":"ContainerStarted","Data":"c06d6d1d6b0078bb53cce0c00389ad43f9329b2063c4ba87af12a1906d0ce2de"}
Sep 10 19:34:54.006212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.006125    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:34:54.059397 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.058752    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq" podStartSLOduration=1.780287545 podStartE2EDuration="2.058727481s" totalImagesPullingTime="278.439936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:34:54.056751269 +0000 UTC m=+882.873360862" watchObservedRunningTime="2026-09-10 19:34:54.058727481 +0000 UTC m=+882.875337050"
Sep 10 19:34:54.194247 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.194208    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:34:54.194476 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.194412    2558 patch_prober.go:28] interesting pod/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 19:34:54.194523 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:54.194472    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 19:34:55.194518 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:55.194483    2558 patch_prober.go:28] interesting pod/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 19:34:55.194929 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:55.194541    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 19:34:56.194326 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:56.194291    2558 patch_prober.go:28] interesting pod/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 19:34:56.194538 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:56.194351    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 19:34:57.194873 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:57.194837    2558 patch_prober.go:28] interesting pod/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 19:34:57.195261 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:57.194895    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 19:34:58.194248 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:58.194207    2558 patch_prober.go:28] interesting pod/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 19:34:58.194458 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:58.194291    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 19:34:59.194106 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:59.194069    2558 patch_prober.go:28] interesting pod/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 19:34:59.194540 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:34:59.194128    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 19:35:00.017530 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:00.017499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:35:00.198339 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:00.198312    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:35:00.198806 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:00.198726    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:35:00.199448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:00.199430    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:35:15.047660 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.047626    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"]
Sep 10 19:35:15.048697 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.048620    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7" podUID="d3582127-c813-4a7e-9cf9-b15e04a6f9b6" containerName="maas-api" containerID="cri-o://444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f" gracePeriod=30
Sep 10 19:35:15.291151 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.291126    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:35:15.481897 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.481860    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-openshift-service-ca\") pod \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") "
Sep 10 19:35:15.482086 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.481965    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-metrics-certs\") pod \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") "
Sep 10 19:35:15.482086 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.481982    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n99n\" (UniqueName: \"kubernetes.io/projected/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-kube-api-access-9n99n\") pod \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") "
Sep 10 19:35:15.482226 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.482095    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls\") pod \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\" (UID: \"d3582127-c813-4a7e-9cf9-b15e04a6f9b6\") "
Sep 10 19:35:15.482303 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.482278    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d3582127-c813-4a7e-9cf9-b15e04a6f9b6" (UID: "d3582127-c813-4a7e-9cf9-b15e04a6f9b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:35:15.482494 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.482468    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:15.484287 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.484262    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d3582127-c813-4a7e-9cf9-b15e04a6f9b6" (UID: "d3582127-c813-4a7e-9cf9-b15e04a6f9b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:35:15.484287 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.484274    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d3582127-c813-4a7e-9cf9-b15e04a6f9b6" (UID: "d3582127-c813-4a7e-9cf9-b15e04a6f9b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:35:15.484443 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.484304    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-kube-api-access-9n99n" (OuterVolumeSpecName: "kube-api-access-9n99n") pod "d3582127-c813-4a7e-9cf9-b15e04a6f9b6" (UID: "d3582127-c813-4a7e-9cf9-b15e04a6f9b6"). InnerVolumeSpecName "kube-api-access-9n99n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:35:15.583181 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.583141    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:15.583338 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.583186    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n99n\" (UniqueName: \"kubernetes.io/projected/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-kube-api-access-9n99n\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:15.583338 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.583201    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3582127-c813-4a7e-9cf9-b15e04a6f9b6-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:15.594082 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.594050    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"]
Sep 10 19:35:15.594281 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:15.594250    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy" containerID="cri-o://ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7" gracePeriod=30
Sep 10 19:35:16.147018 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.146979    2558 generic.go:356] "Generic (PLEG): container finished" podID="d3582127-c813-4a7e-9cf9-b15e04a6f9b6" containerID="444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f" exitCode=0
Sep 10 19:35:16.147534 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.147040    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"
Sep 10 19:35:16.147534 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.147095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7" event={"ID":"d3582127-c813-4a7e-9cf9-b15e04a6f9b6","Type":"ContainerDied","Data":"444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f"}
Sep 10 19:35:16.147534 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.147168    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7" event={"ID":"d3582127-c813-4a7e-9cf9-b15e04a6f9b6","Type":"ContainerDied","Data":"e53fadbd2bcb92e6fae12b8d2220d1ed8ca2f494221efb7d4815555d3771bbc4"}
Sep 10 19:35:16.147534 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.147205    2558 scope.go:117] "RemoveContainer" containerID="444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f"
Sep 10 19:35:16.157047 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.157028    2558 scope.go:117] "RemoveContainer" containerID="444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f"
Sep 10 19:35:16.157337 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:16.157318    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f\": container with ID starting with 444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f not found: ID does not exist" containerID="444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f"
Sep 10 19:35:16.157422 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.157345    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f"} err="failed to get container status \"444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f\": rpc error: code = NotFound desc = could not find container \"444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f\": container with ID starting with 444c3906acdc430a6ed258b1067ece132c48dd21b744cc3e778aaf7f36a7421f not found: ID does not exist"
Sep 10 19:35:16.171783 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.171753    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"]
Sep 10 19:35:16.174716 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.174693    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f7189cc9-7d59cfc49d-2lwz7"]
Sep 10 19:35:16.691877 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.691841    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"]
Sep 10 19:35:16.692568 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.692546    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3582127-c813-4a7e-9cf9-b15e04a6f9b6" containerName="maas-api"
Sep 10 19:35:16.692624 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.692573    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3582127-c813-4a7e-9cf9-b15e04a6f9b6" containerName="maas-api"
Sep 10 19:35:16.692712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.692699    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3582127-c813-4a7e-9cf9-b15e04a6f9b6" containerName="maas-api"
Sep 10 19:35:16.697842 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.697820    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.702434 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.702412    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-fd056b79-gw-openshift-default-dockercfg-xm792\""
Sep 10 19:35:16.705729 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.705702    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"]
Sep 10 19:35:16.794555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.794499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-envoy\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.794754 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.794621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-credential-socket\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.794754 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.794683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-token\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.794887 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.794823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-socket\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.794887 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.794858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-podinfo\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.795008 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.794889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-data\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.795008 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.794932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-certs\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.795008 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.795003    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpc64\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-kube-api-access-xpc64\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.795170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.795093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b512fe27-7819-4593-93f5-327c6d7db0cb-istiod-ca-cert\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.896260 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896230    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-credential-socket\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.896563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-token\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.896563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-socket\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.896563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-podinfo\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.896563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-data\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.896563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-certs\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.897102 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpc64\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-kube-api-access-xpc64\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.897102 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b512fe27-7819-4593-93f5-327c6d7db0cb-istiod-ca-cert\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.897102 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-envoy\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.897102 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.896812    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-socket\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.897102 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.897028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-credential-socket\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.897723 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.897652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b512fe27-7819-4593-93f5-327c6d7db0cb-istiod-ca-cert\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.897828 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.897801    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-data\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.898488 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.898462    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-certs\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.899583 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.899559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-envoy\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.900524 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.900494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-podinfo\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.909367 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.909341    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpc64\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-kube-api-access-xpc64\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:16.911616 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:16.911594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-token\") pod \"e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") " pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:17.011847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:17.011764    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:17.298221 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:35:17.298188    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb512fe27_7819_4593_93f5_327c6d7db0cb.slice/crio-a9f751252f54ff7d56c1c6ecf74cfe33c101106a208bb70c05ff938fd1400e27 WatchSource:0}: Error finding container a9f751252f54ff7d56c1c6ecf74cfe33c101106a208bb70c05ff938fd1400e27: Status 404 returned error can't find the container with id a9f751252f54ff7d56c1c6ecf74cfe33c101106a208bb70c05ff938fd1400e27
Sep 10 19:35:17.299150 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:17.299118    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"]
Sep 10 19:35:17.300629 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:17.300589    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:17.300710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:17.300669    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:17.300749 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:17.300709    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:17.656258 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:17.656181    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3582127-c813-4a7e-9cf9-b15e04a6f9b6" path="/var/lib/kubelet/pods/d3582127-c813-4a7e-9cf9-b15e04a6f9b6/volumes"
Sep 10 19:35:18.168748 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:18.168710    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" event={"ID":"b512fe27-7819-4593-93f5-327c6d7db0cb","Type":"ContainerStarted","Data":"35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f"}
Sep 10 19:35:18.168972 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:18.168773    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" event={"ID":"b512fe27-7819-4593-93f5-327c6d7db0cb","Type":"ContainerStarted","Data":"a9f751252f54ff7d56c1c6ecf74cfe33c101106a208bb70c05ff938fd1400e27"}
Sep 10 19:35:18.194146 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:18.194096    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" podStartSLOduration=2.194079261 podStartE2EDuration="2.194079261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:18.191329812 +0000 UTC m=+907.007939390" watchObservedRunningTime="2026-09-10 19:35:18.194079261 +0000 UTC m=+907.010688829"
Sep 10 19:35:19.011941 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.011904    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:19.017368 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.017342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:19.174980 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.174946    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:19.175819 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.175800    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:19.844062 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.844026    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"]
Sep 10 19:35:19.848489 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.848466    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:19.851220 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.851202    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-fd056b79-serving-cert\""
Sep 10 19:35:19.882601 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.882573    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"]
Sep 10 19:35:19.926439 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.926407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:19.926639 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.926470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-openshift-service-ca\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:19.926639 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.926496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ltkp\" (UniqueName: \"kubernetes.io/projected/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-kube-api-access-9ltkp\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:19.926639 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:19.926513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-metrics-certs\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.027821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.027787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.028272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.027845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-openshift-service-ca\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.028272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.027865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ltkp\" (UniqueName: \"kubernetes.io/projected/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-kube-api-access-9ltkp\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.028272 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.027881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-metrics-certs\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.028272 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:20.027947    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-serving-cert: secret "maas-api-e2e-migrate-fd056b79-serving-cert" not found
Sep 10 19:35:20.028272 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:20.028022    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls podName:49515cfa-9fa6-4b04-a794-c9bcf454fd9d nodeName:}" failed. No retries permitted until 2026-09-10 19:35:20.52800132 +0000 UTC m=+909.344610877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls") pod "maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" (UID: "49515cfa-9fa6-4b04-a794-c9bcf454fd9d") : secret "maas-api-e2e-migrate-fd056b79-serving-cert" not found
Sep 10 19:35:20.028633 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.028615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-openshift-service-ca\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.030286 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.030262    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-metrics-certs\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.035889 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.035867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ltkp\" (UniqueName: \"kubernetes.io/projected/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-kube-api-access-9ltkp\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.532359 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.532329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:20.532549 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:20.532485    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-serving-cert: secret "maas-api-e2e-migrate-fd056b79-serving-cert" not found
Sep 10 19:35:20.532598 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:20.532557    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls podName:49515cfa-9fa6-4b04-a794-c9bcf454fd9d nodeName:}" failed. No retries permitted until 2026-09-10 19:35:21.532542584 +0000 UTC m=+910.349152143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls") pod "maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" (UID: "49515cfa-9fa6-4b04-a794-c9bcf454fd9d") : secret "maas-api-e2e-migrate-fd056b79-serving-cert" not found
Sep 10 19:35:20.871761 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.871736    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:35:20.938061 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938030    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-data\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938083    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-credential-socket\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938116    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-socket\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938167    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqk7t\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-kube-api-access-mqk7t\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938364 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938223    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istiod-ca-cert\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938364 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938253    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-envoy\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938364 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938300    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-token\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938364 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938341    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-podinfo\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938292    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:20.938595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938404    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:20.938595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938420    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-certs\") pod \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\" (UID: \"9498b0ca-9d6c-4e44-9e81-4edda84068ed\") "
Sep 10 19:35:20.938595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938477    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:20.938814 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938615    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:20.938814 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938697    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:35:20.938940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938854    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:20.938940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938867    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:20.938940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938876    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:20.938940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938892    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:20.938940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.938902    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:20.941106 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.941077    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-kube-api-access-mqk7t" (OuterVolumeSpecName: "kube-api-access-mqk7t") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "kube-api-access-mqk7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:35:20.941237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.941178    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:20.941237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.941192    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:35:20.941237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:20.941200    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "9498b0ca-9d6c-4e44-9e81-4edda84068ed" (UID: "9498b0ca-9d6c-4e44-9e81-4edda84068ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:35:21.040553 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.040526    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:21.040553 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.040552    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:21.040879 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.040561    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9498b0ca-9d6c-4e44-9e81-4edda84068ed-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:21.040879 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.040570    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqk7t\" (UniqueName: \"kubernetes.io/projected/9498b0ca-9d6c-4e44-9e81-4edda84068ed-kube-api-access-mqk7t\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:21.188050 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.187964    2558 generic.go:356] "Generic (PLEG): container finished" podID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerID="ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7" exitCode=0
Sep 10 19:35:21.188050 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.188010    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"
Sep 10 19:35:21.188050 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.188042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" event={"ID":"9498b0ca-9d6c-4e44-9e81-4edda84068ed","Type":"ContainerDied","Data":"ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7"}
Sep 10 19:35:21.188333 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.188091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s" event={"ID":"9498b0ca-9d6c-4e44-9e81-4edda84068ed","Type":"ContainerDied","Data":"4a21db930c9b3981796044248606cefeda64e1fde053696a2933caa6607ccd2f"}
Sep 10 19:35:21.188333 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.188113    2558 scope.go:117] "RemoveContainer" containerID="ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7"
Sep 10 19:35:21.197817 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.197800    2558 scope.go:117] "RemoveContainer" containerID="17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2"
Sep 10 19:35:21.206809 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.206791    2558 scope.go:117] "RemoveContainer" containerID="ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7"
Sep 10 19:35:21.207101 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:21.207081    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7\": container with ID starting with ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7 not found: ID does not exist" containerID="ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7"
Sep 10 19:35:21.207142 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.207111    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7"} err="failed to get container status \"ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7\": rpc error: code = NotFound desc = could not find container \"ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7\": container with ID starting with ffcbbf26c1f968d17aa04597a8ad5448c67015fc0c050cad97f0042bafb9ced7 not found: ID does not exist"
Sep 10 19:35:21.207142 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.207128    2558 scope.go:117] "RemoveContainer" containerID="17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2"
Sep 10 19:35:21.207499 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:21.207465    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2\": container with ID starting with 17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2 not found: ID does not exist" containerID="17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2"
Sep 10 19:35:21.207616 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.207498    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2"} err="failed to get container status \"17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2\": rpc error: code = NotFound desc = could not find container \"17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2\": container with ID starting with 17982dab1831bfefc487fa0504758e8d86c5d08189b756252575655864579ad2 not found: ID does not exist"
Sep 10 19:35:21.211049 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.211027    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"]
Sep 10 19:35:21.214330 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.214312    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f7189cc9-openshift-default-84f6747dbd-dzg2s"]
Sep 10 19:35:21.546017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.545976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:21.548621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.548594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls\") pod \"maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:21.656295 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.656251    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" path="/var/lib/kubelet/pods/9498b0ca-9d6c-4e44-9e81-4edda84068ed/volumes"
Sep 10 19:35:21.659321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.659296    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:21.942771 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:21.942691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"]
Sep 10 19:35:21.946025 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:35:21.945992    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49515cfa_9fa6_4b04_a794_c9bcf454fd9d.slice/crio-3c1a12fc9333399c7f828f9eac00c0aef6cc17e700a7218698be6e586166c4c9 WatchSource:0}: Error finding container 3c1a12fc9333399c7f828f9eac00c0aef6cc17e700a7218698be6e586166c4c9: Status 404 returned error can't find the container with id 3c1a12fc9333399c7f828f9eac00c0aef6cc17e700a7218698be6e586166c4c9
Sep 10 19:35:22.197417 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:22.197303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" event={"ID":"49515cfa-9fa6-4b04-a794-c9bcf454fd9d","Type":"ContainerStarted","Data":"3c1a12fc9333399c7f828f9eac00c0aef6cc17e700a7218698be6e586166c4c9"}
Sep 10 19:35:23.204879 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:23.204845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" event={"ID":"49515cfa-9fa6-4b04-a794-c9bcf454fd9d","Type":"ContainerStarted","Data":"964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60"}
Sep 10 19:35:23.205254 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:23.204914    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:23.222605 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:23.222563    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" podStartSLOduration=3.923737843 podStartE2EDuration="4.222547172s" totalImagesPullingTime="298.809329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:23.22132169 +0000 UTC m=+912.037931287" watchObservedRunningTime="2026-09-10 19:35:23.222547172 +0000 UTC m=+912.039156740"
Sep 10 19:35:29.216422 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:29.216388    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:38.307995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:38.307958    2558 generic.go:356] "Generic (PLEG): container finished" podID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerID="35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f" exitCode=0
Sep 10 19:35:38.308459 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:38.308032    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" event={"ID":"b512fe27-7819-4593-93f5-327c6d7db0cb","Type":"ContainerDied","Data":"35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f"}
Sep 10 19:35:38.308516 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:38.308461    2558 scope.go:117] "RemoveContainer" containerID="35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f"
Sep 10 19:35:38.309663 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:38.309635    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:38.309747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:38.309703    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:38.309747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:38.309733    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:39.315361 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:39.315315    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" event={"ID":"b512fe27-7819-4593-93f5-327c6d7db0cb","Type":"ContainerStarted","Data":"ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd"}
Sep 10 19:35:40.012934 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:40.012898    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:40.013126 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:40.013065    2558 patch_prober.go:28] interesting pod/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 19:35:40.013126 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:40.013111    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 19:35:41.013078 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:41.013040    2558 patch_prober.go:28] interesting pod/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 19:35:41.013481 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:41.013096    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 19:35:42.012299 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:42.012263    2558 patch_prober.go:28] interesting pod/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 19:35:42.012493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:42.012316    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 19:35:43.013162 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:43.013119    2558 patch_prober.go:28] interesting pod/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 19:35:43.013667 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:43.013190    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 19:35:44.012769 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:44.012732    2558 patch_prober.go:28] interesting pod/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 19:35:44.012943 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:44.012804    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 19:35:45.156482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:45.156430    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:45.157177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:45.157147    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:45.158766 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:45.158747    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:51.285275 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.285238    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"]
Sep 10 19:35:51.285780 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.285512    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" podUID="49515cfa-9fa6-4b04-a794-c9bcf454fd9d" containerName="maas-api" containerID="cri-o://964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60" gracePeriod=30
Sep 10 19:35:51.540484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.540424    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:51.654948 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.654915    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ltkp\" (UniqueName: \"kubernetes.io/projected/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-kube-api-access-9ltkp\") pod \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") "
Sep 10 19:35:51.655122 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.655005    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls\") pod \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") "
Sep 10 19:35:51.655122 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.655072    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-metrics-certs\") pod \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") "
Sep 10 19:35:51.655237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.655149    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-openshift-service-ca\") pod \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\" (UID: \"49515cfa-9fa6-4b04-a794-c9bcf454fd9d\") "
Sep 10 19:35:51.655925 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.655887    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "49515cfa-9fa6-4b04-a794-c9bcf454fd9d" (UID: "49515cfa-9fa6-4b04-a794-c9bcf454fd9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:35:51.661443 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.661414    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "49515cfa-9fa6-4b04-a794-c9bcf454fd9d" (UID: "49515cfa-9fa6-4b04-a794-c9bcf454fd9d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:35:51.662359 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.662327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-kube-api-access-9ltkp" (OuterVolumeSpecName: "kube-api-access-9ltkp") pod "49515cfa-9fa6-4b04-a794-c9bcf454fd9d" (UID: "49515cfa-9fa6-4b04-a794-c9bcf454fd9d"). InnerVolumeSpecName "kube-api-access-9ltkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:35:51.662359 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.662346    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "49515cfa-9fa6-4b04-a794-c9bcf454fd9d" (UID: "49515cfa-9fa6-4b04-a794-c9bcf454fd9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:35:51.683161 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.683134    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"]
Sep 10 19:35:51.683645 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.683363    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy" containerID="cri-o://ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd" gracePeriod=30
Sep 10 19:35:51.756550 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.756515    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:51.756550 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.756545    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ltkp\" (UniqueName: \"kubernetes.io/projected/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-kube-api-access-9ltkp\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:51.756550 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.756555    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:51.756784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:51.756565    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49515cfa-9fa6-4b04-a794-c9bcf454fd9d-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:52.397588 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.397550    2558 generic.go:356] "Generic (PLEG): container finished" podID="49515cfa-9fa6-4b04-a794-c9bcf454fd9d" containerID="964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60" exitCode=0
Sep 10 19:35:52.398054 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.397607    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"
Sep 10 19:35:52.398054 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.397635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" event={"ID":"49515cfa-9fa6-4b04-a794-c9bcf454fd9d","Type":"ContainerDied","Data":"964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60"}
Sep 10 19:35:52.398054 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.397690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57" event={"ID":"49515cfa-9fa6-4b04-a794-c9bcf454fd9d","Type":"ContainerDied","Data":"3c1a12fc9333399c7f828f9eac00c0aef6cc17e700a7218698be6e586166c4c9"}
Sep 10 19:35:52.398054 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.397708    2558 scope.go:117] "RemoveContainer" containerID="964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60"
Sep 10 19:35:52.408958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.408940    2558 scope.go:117] "RemoveContainer" containerID="964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60"
Sep 10 19:35:52.409248 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:52.409226    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60\": container with ID starting with 964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60 not found: ID does not exist" containerID="964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60"
Sep 10 19:35:52.409318 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.409255    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60"} err="failed to get container status \"964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60\": rpc error: code = NotFound desc = could not find container \"964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60\": container with ID starting with 964fd74d9e509a74e746c436e5108ef2f38fb2dee910a25d88c25039ee596b60 not found: ID does not exist"
Sep 10 19:35:52.429332 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.429299    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"]
Sep 10 19:35:52.438444 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.438414    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fd056b79-7467fb5cc4-jld57"]
Sep 10 19:35:52.441064 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441035    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"]
Sep 10 19:35:52.441600 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441577    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy"
Sep 10 19:35:52.441764 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441744    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy"
Sep 10 19:35:52.441764 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441766    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy"
Sep 10 19:35:52.441941 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441776    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy"
Sep 10 19:35:52.441941 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441795    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49515cfa-9fa6-4b04-a794-c9bcf454fd9d" containerName="maas-api"
Sep 10 19:35:52.441941 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441804    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="49515cfa-9fa6-4b04-a794-c9bcf454fd9d" containerName="maas-api"
Sep 10 19:35:52.441941 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441940    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy"
Sep 10 19:35:52.442142 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.441957    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="49515cfa-9fa6-4b04-a794-c9bcf454fd9d" containerName="maas-api"
Sep 10 19:35:52.446504 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.446484    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.448856 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.448835    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b06cf0bb-openshift-default-dockercfg-l5ml9\""
Sep 10 19:35:52.458342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.458318    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"]
Sep 10 19:35:52.562973 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.562943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-envoy\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.562992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-data\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.563015    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-credential-socket\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.563125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-certs\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.563175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-socket\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.563234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c79ee58-4ead-4f32-b926-bc3477eab678-istiod-ca-cert\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.563266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-token\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.563304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f48l\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-kube-api-access-5f48l\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.563441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.563350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-podinfo\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.664827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.664729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-envoy\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.664827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.664789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-data\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.664827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.664813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-credential-socket\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665111 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.664851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-certs\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665111 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.664998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-socket\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665111 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c79ee58-4ead-4f32-b926-bc3477eab678-istiod-ca-cert\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665111 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-token\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665354 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f48l\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-kube-api-access-5f48l\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665354 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665173    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-podinfo\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665354 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-certs\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665354 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-data\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665585 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-socket\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665668 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-credential-socket\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.665856 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.665837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c79ee58-4ead-4f32-b926-bc3477eab678-istiod-ca-cert\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.667213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.667190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-envoy\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.667488 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.667471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-podinfo\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.673183 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.673155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-token\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.673294 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.673279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f48l\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-kube-api-access-5f48l\") pod \"e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") " pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:52.757104 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:52.757068    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:53.037133 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.037103    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"]
Sep 10 19:35:53.038018 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:35:53.037992    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c79ee58_4ead_4f32_b926_bc3477eab678.slice/crio-02516219f32378edcf892fa9d8e1d243ffe511d1982824121f83c1910cc40f21 WatchSource:0}: Error finding container 02516219f32378edcf892fa9d8e1d243ffe511d1982824121f83c1910cc40f21: Status 404 returned error can't find the container with id 02516219f32378edcf892fa9d8e1d243ffe511d1982824121f83c1910cc40f21
Sep 10 19:35:53.040459 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.040425    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:53.040580 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.040493    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:53.040580 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.040529    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:35:53.405459 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.405325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" event={"ID":"2c79ee58-4ead-4f32-b926-bc3477eab678","Type":"ContainerStarted","Data":"c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0"}
Sep 10 19:35:53.406056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.406030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" event={"ID":"2c79ee58-4ead-4f32-b926-bc3477eab678","Type":"ContainerStarted","Data":"02516219f32378edcf892fa9d8e1d243ffe511d1982824121f83c1910cc40f21"}
Sep 10 19:35:53.427011 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.426957    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podStartSLOduration=1.426939784 podStartE2EDuration="1.426939784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:53.426786036 +0000 UTC m=+942.243395629" watchObservedRunningTime="2026-09-10 19:35:53.426939784 +0000 UTC m=+942.243549353"
Sep 10 19:35:53.655947 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.655866    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49515cfa-9fa6-4b04-a794-c9bcf454fd9d" path="/var/lib/kubelet/pods/49515cfa-9fa6-4b04-a794-c9bcf454fd9d/volumes"
Sep 10 19:35:53.757769 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:53.757732    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:54.763840 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:54.763809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:55.424288 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:55.424257    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:55.425194 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:55.425175    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:35:55.993345 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:55.993295    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"]
Sep 10 19:35:55.993860 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:55.993841    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9498b0ca-9d6c-4e44-9e81-4edda84068ed" containerName="istio-proxy"
Sep 10 19:35:55.997072 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:55.997051    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:55.999763 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:55.999738    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b06cf0bb-serving-cert\""
Sep 10 19:35:56.009020 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.008987    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"]
Sep 10 19:35:56.094804 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.094775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdvss\" (UniqueName: \"kubernetes.io/projected/6a45e457-4d44-488e-8e07-91d17f3c8d2d-kube-api-access-fdvss\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.094979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.094833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a45e457-4d44-488e-8e07-91d17f3c8d2d-openshift-service-ca\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.094979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.094916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-metrics-certs\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.094979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.094961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.195480 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.195447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdvss\" (UniqueName: \"kubernetes.io/projected/6a45e457-4d44-488e-8e07-91d17f3c8d2d-kube-api-access-fdvss\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.195675 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.195505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a45e457-4d44-488e-8e07-91d17f3c8d2d-openshift-service-ca\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.195675 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.195568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-metrics-certs\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.195675 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.195602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.195867 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:56.195692    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-serving-cert: secret "maas-api-e2e-ait-b06cf0bb-serving-cert" not found
Sep 10 19:35:56.195867 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:56.195745    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls podName:6a45e457-4d44-488e-8e07-91d17f3c8d2d nodeName:}" failed. No retries permitted until 2026-09-10 19:35:56.695729336 +0000 UTC m=+945.512338881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls") pod "maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh" (UID: "6a45e457-4d44-488e-8e07-91d17f3c8d2d") : secret "maas-api-e2e-ait-b06cf0bb-serving-cert" not found
Sep 10 19:35:56.196282 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.196258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a45e457-4d44-488e-8e07-91d17f3c8d2d-openshift-service-ca\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.198079 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.198059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-metrics-certs\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.204210 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.204191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdvss\" (UniqueName: \"kubernetes.io/projected/6a45e457-4d44-488e-8e07-91d17f3c8d2d-kube-api-access-fdvss\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.700880 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.700837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.703210 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.703187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls\") pod \"maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.913390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.913346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:56.935712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:56.935685    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:57.004447 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004369    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-envoy\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004447 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004423    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-podinfo\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004464    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpc64\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-kube-api-access-xpc64\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-socket\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004628    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-token\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004664    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-credential-socket\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004694    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b512fe27-7819-4593-93f5-327c6d7db0cb-istiod-ca-cert\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004721    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-data\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004759    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-certs\") pod \"b512fe27-7819-4593-93f5-327c6d7db0cb\" (UID: \"b512fe27-7819-4593-93f5-327c6d7db0cb\") "
Sep 10 19:35:57.004966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004785    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:57.005403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.004990    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:57.005403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.005215    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.005403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.005218    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:57.005403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.005238    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.006553 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.005503    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:57.006553 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.005524    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b512fe27-7819-4593-93f5-327c6d7db0cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:35:57.007015 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.006987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-kube-api-access-xpc64" (OuterVolumeSpecName: "kube-api-access-xpc64") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "kube-api-access-xpc64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:35:57.007210 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.007191    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:35:57.007480 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.007457    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:35:57.007656 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.007637    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "b512fe27-7819-4593-93f5-327c6d7db0cb" (UID: "b512fe27-7819-4593-93f5-327c6d7db0cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:35:57.105979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.105937    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b512fe27-7819-4593-93f5-327c6d7db0cb-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.105979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.105976    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.105979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.105989    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.106269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.106003    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.106269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.106015    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.106269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.106028    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpc64\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-kube-api-access-xpc64\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.106269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.106044    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b512fe27-7819-4593-93f5-327c6d7db0cb-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:35:57.190209 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.190177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"]
Sep 10 19:35:57.191282 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:35:57.191252    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a45e457_4d44_488e_8e07_91d17f3c8d2d.slice/crio-cc0f8e6711ad2b4166673c13d612fcbb144c76930ecad20cc98cae790d40dfe4 WatchSource:0}: Error finding container cc0f8e6711ad2b4166673c13d612fcbb144c76930ecad20cc98cae790d40dfe4: Status 404 returned error can't find the container with id cc0f8e6711ad2b4166673c13d612fcbb144c76930ecad20cc98cae790d40dfe4
Sep 10 19:35:57.437340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.437220    2558 generic.go:356] "Generic (PLEG): container finished" podID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerID="ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd" exitCode=0
Sep 10 19:35:57.437340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.437270    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"
Sep 10 19:35:57.437340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.437310    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" event={"ID":"b512fe27-7819-4593-93f5-327c6d7db0cb","Type":"ContainerDied","Data":"ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd"}
Sep 10 19:35:57.437655 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.437389    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5" event={"ID":"b512fe27-7819-4593-93f5-327c6d7db0cb","Type":"ContainerDied","Data":"a9f751252f54ff7d56c1c6ecf74cfe33c101106a208bb70c05ff938fd1400e27"}
Sep 10 19:35:57.437655 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.437422    2558 scope.go:117] "RemoveContainer" containerID="ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd"
Sep 10 19:35:57.438757 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.438733    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh" event={"ID":"6a45e457-4d44-488e-8e07-91d17f3c8d2d","Type":"ContainerStarted","Data":"cc0f8e6711ad2b4166673c13d612fcbb144c76930ecad20cc98cae790d40dfe4"}
Sep 10 19:35:57.448127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.448107    2558 scope.go:117] "RemoveContainer" containerID="35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f"
Sep 10 19:35:57.457546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.457521    2558 scope.go:117] "RemoveContainer" containerID="ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd"
Sep 10 19:35:57.458062 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:57.457894    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd\": container with ID starting with ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd not found: ID does not exist" containerID="ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd"
Sep 10 19:35:57.458062 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.457930    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd"} err="failed to get container status \"ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd\": rpc error: code = NotFound desc = could not find container \"ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd\": container with ID starting with ffc817a6a61c76c0ab538bcb74775b8cd6e026e00f64985a10666092dbb450fd not found: ID does not exist"
Sep 10 19:35:57.458062 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.457955    2558 scope.go:117] "RemoveContainer" containerID="35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f"
Sep 10 19:35:57.458478 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:35:57.458283    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f\": container with ID starting with 35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f not found: ID does not exist" containerID="35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f"
Sep 10 19:35:57.458478 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.458317    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f"} err="failed to get container status \"35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f\": rpc error: code = NotFound desc = could not find container \"35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f\": container with ID starting with 35b6b130ed2574a2c6bc8a08893c3dc0d3f5f3281e7b037f3ad19608b7cfb47f not found: ID does not exist"
Sep 10 19:35:57.463858 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.463729    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"]
Sep 10 19:35:57.466475 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.466454    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-fd056b79-gw-openshift-default-584df48476-t7dl5"]
Sep 10 19:35:57.662163 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:57.658268    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" path="/var/lib/kubelet/pods/b512fe27-7819-4593-93f5-327c6d7db0cb/volumes"
Sep 10 19:35:58.447460 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:58.447421    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh" event={"ID":"6a45e457-4d44-488e-8e07-91d17f3c8d2d","Type":"ContainerStarted","Data":"ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb"}
Sep 10 19:35:58.447894 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:58.447550    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:35:58.466243 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:35:58.466189    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh" podStartSLOduration=2.902810195 podStartE2EDuration="3.466176067s" totalImagesPullingTime="563.365872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:35:58.465004856 +0000 UTC m=+947.281614458" watchObservedRunningTime="2026-09-10 19:35:58.466176067 +0000 UTC m=+947.282785634"
Sep 10 19:36:04.459155 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:04.459119    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:36:11.595329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.595289    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"]
Sep 10 19:36:11.595767 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.595604    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" podUID="20eceaaf-f020-440b-98e5-2e42765a63e2" containerName="maas-api" containerID="cri-o://8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c" gracePeriod=30
Sep 10 19:36:11.906414 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.906384    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:36:11.960531 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.959671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxj89\" (UniqueName: \"kubernetes.io/projected/20eceaaf-f020-440b-98e5-2e42765a63e2-kube-api-access-mxj89\") pod \"20eceaaf-f020-440b-98e5-2e42765a63e2\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") "
Sep 10 19:36:11.960531 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.959772    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls\") pod \"20eceaaf-f020-440b-98e5-2e42765a63e2\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") "
Sep 10 19:36:11.960531 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.959832    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20eceaaf-f020-440b-98e5-2e42765a63e2-openshift-service-ca\") pod \"20eceaaf-f020-440b-98e5-2e42765a63e2\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") "
Sep 10 19:36:11.960531 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.959860    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-metrics-certs\") pod \"20eceaaf-f020-440b-98e5-2e42765a63e2\" (UID: \"20eceaaf-f020-440b-98e5-2e42765a63e2\") "
Sep 10 19:36:11.961822 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.961778    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20eceaaf-f020-440b-98e5-2e42765a63e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20eceaaf-f020-440b-98e5-2e42765a63e2" (UID: "20eceaaf-f020-440b-98e5-2e42765a63e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:36:11.970802 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.970759    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "20eceaaf-f020-440b-98e5-2e42765a63e2" (UID: "20eceaaf-f020-440b-98e5-2e42765a63e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:36:11.972127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.971955    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20eceaaf-f020-440b-98e5-2e42765a63e2" (UID: "20eceaaf-f020-440b-98e5-2e42765a63e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:36:11.972127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:11.972080    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20eceaaf-f020-440b-98e5-2e42765a63e2-kube-api-access-mxj89" (OuterVolumeSpecName: "kube-api-access-mxj89") pod "20eceaaf-f020-440b-98e5-2e42765a63e2" (UID: "20eceaaf-f020-440b-98e5-2e42765a63e2"). InnerVolumeSpecName "kube-api-access-mxj89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:36:12.060945 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.060910    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:12.060945 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.060941    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20eceaaf-f020-440b-98e5-2e42765a63e2-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:12.060945 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.060950    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20eceaaf-f020-440b-98e5-2e42765a63e2-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:12.061335 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.060960    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxj89\" (UniqueName: \"kubernetes.io/projected/20eceaaf-f020-440b-98e5-2e42765a63e2-kube-api-access-mxj89\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:12.528171 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.528135    2558 generic.go:356] "Generic (PLEG): container finished" podID="20eceaaf-f020-440b-98e5-2e42765a63e2" containerID="8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c" exitCode=0
Sep 10 19:36:12.528311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.528178    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"
Sep 10 19:36:12.528311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.528199    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" event={"ID":"20eceaaf-f020-440b-98e5-2e42765a63e2","Type":"ContainerDied","Data":"8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c"}
Sep 10 19:36:12.528311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.528239    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj" event={"ID":"20eceaaf-f020-440b-98e5-2e42765a63e2","Type":"ContainerDied","Data":"beb6326564e959495a815483e797f7e298b8c73a45da7b0a2e1ba56429a5496e"}
Sep 10 19:36:12.528311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.528262    2558 scope.go:117] "RemoveContainer" containerID="8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c"
Sep 10 19:36:12.539455 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.539386    2558 scope.go:117] "RemoveContainer" containerID="8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c"
Sep 10 19:36:12.539717 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:36:12.539691    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c\": container with ID starting with 8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c not found: ID does not exist" containerID="8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c"
Sep 10 19:36:12.539790 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.539728    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c"} err="failed to get container status \"8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c\": rpc error: code = NotFound desc = could not find container \"8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c\": container with ID starting with 8e2f8033bba6cfe4ff8642844b09e49fb0b9ff53031731272feff47d6fd3a89c not found: ID does not exist"
Sep 10 19:36:12.553120 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.553096    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"]
Sep 10 19:36:12.560494 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:12.560472    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-18c3c3-5585bbbb58-cntrj"]
Sep 10 19:36:13.658248 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:13.658210    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20eceaaf-f020-440b-98e5-2e42765a63e2" path="/var/lib/kubelet/pods/20eceaaf-f020-440b-98e5-2e42765a63e2/volumes"
Sep 10 19:36:15.550954 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:15.550862    2558 generic.go:356] "Generic (PLEG): container finished" podID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerID="c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0" exitCode=0
Sep 10 19:36:15.550954 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:15.550933    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" event={"ID":"2c79ee58-4ead-4f32-b926-bc3477eab678","Type":"ContainerDied","Data":"c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0"}
Sep 10 19:36:15.551482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:15.551345    2558 scope.go:117] "RemoveContainer" containerID="c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0"
Sep 10 19:36:15.552558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:15.552519    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:15.552654 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:15.552586    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:15.552654 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:15.552615    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:16.559289 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:16.559258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" event={"ID":"2c79ee58-4ead-4f32-b926-bc3477eab678","Type":"ContainerStarted","Data":"858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1"}
Sep 10 19:36:16.757664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:16.757627    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:36:16.757834 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:16.757813    2558 patch_prober.go:28] interesting pod/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 19:36:16.757877 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:16.757857    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 19:36:17.757612 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:17.757573    2558 patch_prober.go:28] interesting pod/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 19:36:17.758139 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:17.757641    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 19:36:18.757583 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:18.757544    2558 patch_prober.go:28] interesting pod/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 19:36:18.757799 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:18.757618    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 19:36:19.762570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.761980    2558 patch_prober.go:28] interesting pod/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 19:36:19.762570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.762051    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 19:36:19.785486 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.785451    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"]
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.787481    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.787506    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.787525    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.787534    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.787551    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20eceaaf-f020-440b-98e5-2e42765a63e2" containerName="maas-api"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.787561    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="20eceaaf-f020-440b-98e5-2e42765a63e2" containerName="maas-api"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.788147    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.788169    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="20eceaaf-f020-440b-98e5-2e42765a63e2" containerName="maas-api"
Sep 10 19:36:19.789413 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.788178    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b512fe27-7819-4593-93f5-327c6d7db0cb" containerName="istio-proxy"
Sep 10 19:36:19.797962 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.797937    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"]
Sep 10 19:36:19.798132 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.798109    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.801044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.800776    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-8f9c8a-openshift-default-dockercfg-q785c\""
Sep 10 19:36:19.945641 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-socket\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.945832 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-certs\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.945832 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-podinfo\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.945832 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be00a47-1273-4434-b9e6-953da3ff97fb-istiod-ca-cert\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.945832 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-envoy\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.945832 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-data\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.946126 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4m6\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-kube-api-access-vs4m6\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.946126 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-credential-socket\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:19.946126 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:19.945931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-token\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047149 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-podinfo\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047149 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be00a47-1273-4434-b9e6-953da3ff97fb-istiod-ca-cert\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-envoy\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-data\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4m6\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-kube-api-access-vs4m6\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-credential-socket\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-token\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047392    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-socket\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047756 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-certs\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.047861 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.047837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-certs\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.048816 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.048793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-data\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.049110 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.049081    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-credential-socket\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.049348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.049326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-socket\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.049853 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.049830    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be00a47-1273-4434-b9e6-953da3ff97fb-istiod-ca-cert\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.050726 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.050703    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-envoy\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.063401 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.059846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-podinfo\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.074547 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.074442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-token\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.075017 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.074997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4m6\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-kube-api-access-vs4m6\") pod \"e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") " pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.109701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.109664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:20.413425 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.413328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"]
Sep 10 19:36:20.413558 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:36:20.413502    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be00a47_1273_4434_b9e6_953da3ff97fb.slice/crio-cfffccbd53a6e89089d56cc28c845194ba758469ad259e3a99372d28120193ad WatchSource:0}: Error finding container cfffccbd53a6e89089d56cc28c845194ba758469ad259e3a99372d28120193ad: Status 404 returned error can't find the container with id cfffccbd53a6e89089d56cc28c845194ba758469ad259e3a99372d28120193ad
Sep 10 19:36:20.415368 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.415334    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:20.415472 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.415412    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:20.415472 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.415441    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:20.589010 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.588964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" event={"ID":"0be00a47-1273-4434-b9e6-953da3ff97fb","Type":"ContainerStarted","Data":"bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66"}
Sep 10 19:36:20.589201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.589027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" event={"ID":"0be00a47-1273-4434-b9e6-953da3ff97fb","Type":"ContainerStarted","Data":"cfffccbd53a6e89089d56cc28c845194ba758469ad259e3a99372d28120193ad"}
Sep 10 19:36:20.611923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.611854    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podStartSLOduration=1.611830507 podStartE2EDuration="1.611830507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:36:20.609552593 +0000 UTC m=+969.426162162" watchObservedRunningTime="2026-09-10 19:36:20.611830507 +0000 UTC m=+969.428440068"
Sep 10 19:36:20.758358 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.758312    2558 patch_prober.go:28] interesting pod/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 19:36:20.758582 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:20.758402    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 19:36:21.110745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:21.110664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:21.116218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:21.116189    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:21.595457 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:21.595427    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:21.596331 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:21.596314    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:21.758396 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:21.757770    2558 patch_prober.go:28] interesting pod/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 19:36:21.758396 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:21.757838    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 19:36:22.918740 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:22.918530    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:36:22.919186 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:22.919117    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:36:22.920201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:22.920179    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:36:23.801520 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.801488    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"]
Sep 10 19:36:23.804921 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.804883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.807146 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.807122    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-8f9c8a-serving-cert\""
Sep 10 19:36:23.814566 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.814330    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"]
Sep 10 19:36:23.892122 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.892091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-metrics-certs\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.892290 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.892221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-openshift-service-ca\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.892290 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.892264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.892403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.892304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pl86\" (UniqueName: \"kubernetes.io/projected/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-kube-api-access-9pl86\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.993460 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.993423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-openshift-service-ca\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.993934 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.993479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.993934 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.993531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pl86\" (UniqueName: \"kubernetes.io/projected/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-kube-api-access-9pl86\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.993934 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.993580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-metrics-certs\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.993934 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:36:23.993650    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-serving-cert: secret "maas-api-e2e-explicit-8f9c8a-serving-cert" not found
Sep 10 19:36:23.993934 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:36:23.993722    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls podName:bfd2737b-5f0a-445e-b4d5-ecaa786ee484 nodeName:}" failed. No retries permitted until 2026-09-10 19:36:24.493703698 +0000 UTC m=+973.310313248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls") pod "maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn" (UID: "bfd2737b-5f0a-445e-b4d5-ecaa786ee484") : secret "maas-api-e2e-explicit-8f9c8a-serving-cert" not found
Sep 10 19:36:23.994151 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.994111    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-openshift-service-ca\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:23.996072 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:23.996047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-metrics-certs\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:24.004255 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:24.004235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pl86\" (UniqueName: \"kubernetes.io/projected/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-kube-api-access-9pl86\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:24.499193 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:24.499157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:24.501658 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:24.501633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls\") pod \"maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:24.721306 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:24.721270    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:24.993621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:24.993591    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"]
Sep 10 19:36:24.995088 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:36:24.995062    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd2737b_5f0a_445e_b4d5_ecaa786ee484.slice/crio-3a96cd84d1091958664fbfdd326b25437fc787b85c6deb7791c3f63671d7ce52 WatchSource:0}: Error finding container 3a96cd84d1091958664fbfdd326b25437fc787b85c6deb7791c3f63671d7ce52: Status 404 returned error can't find the container with id 3a96cd84d1091958664fbfdd326b25437fc787b85c6deb7791c3f63671d7ce52
Sep 10 19:36:25.619847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:25.619807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn" event={"ID":"bfd2737b-5f0a-445e-b4d5-ecaa786ee484","Type":"ContainerStarted","Data":"3a96cd84d1091958664fbfdd326b25437fc787b85c6deb7791c3f63671d7ce52"}
Sep 10 19:36:26.628236 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:26.628198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn" event={"ID":"bfd2737b-5f0a-445e-b4d5-ecaa786ee484","Type":"ContainerStarted","Data":"518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1"}
Sep 10 19:36:26.628675 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:26.628347    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:26.647742 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:26.647684    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn" podStartSLOduration=2.981661344 podStartE2EDuration="3.647664867s" totalImagesPullingTime="666.003523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:36:26.644610192 +0000 UTC m=+975.461219787" watchObservedRunningTime="2026-09-10 19:36:26.647664867 +0000 UTC m=+975.464274437"
Sep 10 19:36:26.982231 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:26.982193    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"]
Sep 10 19:36:26.982470 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:26.982443    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh" podUID="6a45e457-4d44-488e-8e07-91d17f3c8d2d" containerName="maas-api" containerID="cri-o://ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb" gracePeriod=30
Sep 10 19:36:27.234052 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.233987    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:36:27.327448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.327408    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a45e457-4d44-488e-8e07-91d17f3c8d2d-openshift-service-ca\") pod \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") "
Sep 10 19:36:27.327448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.327454    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls\") pod \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") "
Sep 10 19:36:27.327667 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.327495    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-metrics-certs\") pod \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") "
Sep 10 19:36:27.327667 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.327625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdvss\" (UniqueName: \"kubernetes.io/projected/6a45e457-4d44-488e-8e07-91d17f3c8d2d-kube-api-access-fdvss\") pod \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\" (UID: \"6a45e457-4d44-488e-8e07-91d17f3c8d2d\") "
Sep 10 19:36:27.327857 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.327818    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a45e457-4d44-488e-8e07-91d17f3c8d2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a45e457-4d44-488e-8e07-91d17f3c8d2d" (UID: "6a45e457-4d44-488e-8e07-91d17f3c8d2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:36:27.329743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.329716    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a45e457-4d44-488e-8e07-91d17f3c8d2d" (UID: "6a45e457-4d44-488e-8e07-91d17f3c8d2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:36:27.329834 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.329758    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6a45e457-4d44-488e-8e07-91d17f3c8d2d" (UID: "6a45e457-4d44-488e-8e07-91d17f3c8d2d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:36:27.329834 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.329778    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a45e457-4d44-488e-8e07-91d17f3c8d2d-kube-api-access-fdvss" (OuterVolumeSpecName: "kube-api-access-fdvss") pod "6a45e457-4d44-488e-8e07-91d17f3c8d2d" (UID: "6a45e457-4d44-488e-8e07-91d17f3c8d2d"). InnerVolumeSpecName "kube-api-access-fdvss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:36:27.428827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.428790    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:27.428827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.428820    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdvss\" (UniqueName: \"kubernetes.io/projected/6a45e457-4d44-488e-8e07-91d17f3c8d2d-kube-api-access-fdvss\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:27.428827 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.428829    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a45e457-4d44-488e-8e07-91d17f3c8d2d-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:27.429063 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.428838    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a45e457-4d44-488e-8e07-91d17f3c8d2d-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:27.635721 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.635640    2558 generic.go:356] "Generic (PLEG): container finished" podID="6a45e457-4d44-488e-8e07-91d17f3c8d2d" containerID="ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb" exitCode=0
Sep 10 19:36:27.635721 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.635681    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"
Sep 10 19:36:27.636160 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.635722    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh" event={"ID":"6a45e457-4d44-488e-8e07-91d17f3c8d2d","Type":"ContainerDied","Data":"ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb"}
Sep 10 19:36:27.636160 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.635774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh" event={"ID":"6a45e457-4d44-488e-8e07-91d17f3c8d2d","Type":"ContainerDied","Data":"cc0f8e6711ad2b4166673c13d612fcbb144c76930ecad20cc98cae790d40dfe4"}
Sep 10 19:36:27.636160 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.635805    2558 scope.go:117] "RemoveContainer" containerID="ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb"
Sep 10 19:36:27.648480 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.648388    2558 scope.go:117] "RemoveContainer" containerID="ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb"
Sep 10 19:36:27.648906 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:36:27.648881    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb\": container with ID starting with ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb not found: ID does not exist" containerID="ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb"
Sep 10 19:36:27.649000 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.648913    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb"} err="failed to get container status \"ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb\": rpc error: code = NotFound desc = could not find container \"ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb\": container with ID starting with ac96f10373a333fe37f90aa70c5bc0ccc2bdc4720a6b87c68be4e532132fa9bb not found: ID does not exist"
Sep 10 19:36:27.659521 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.659493    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"]
Sep 10 19:36:27.666690 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:27.666661    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b06cf0bb-d875977b9-wwddh"]
Sep 10 19:36:28.355633 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:28.355600    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"]
Sep 10 19:36:28.355905 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:28.355875    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy" containerID="cri-o://858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1" gracePeriod=30
Sep 10 19:36:29.657058 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:29.657020    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a45e457-4d44-488e-8e07-91d17f3c8d2d" path="/var/lib/kubelet/pods/6a45e457-4d44-488e-8e07-91d17f3c8d2d/volumes"
Sep 10 19:36:32.313385 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.313331    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"]
Sep 10 19:36:32.313995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.313975    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a45e457-4d44-488e-8e07-91d17f3c8d2d" containerName="maas-api"
Sep 10 19:36:32.313995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.313997    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a45e457-4d44-488e-8e07-91d17f3c8d2d" containerName="maas-api"
Sep 10 19:36:32.314145 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.314134    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a45e457-4d44-488e-8e07-91d17f3c8d2d" containerName="maas-api"
Sep 10 19:36:32.317408 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.317368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.319992 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.319967    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-cdcbd691-serving-cert\""
Sep 10 19:36:32.330284 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.330258    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"]
Sep 10 19:36:32.478452 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.478415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-openshift-service-ca\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.478615 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.478462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-maas-api-tls\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.478679 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.478629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk4wv\" (UniqueName: \"kubernetes.io/projected/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-kube-api-access-kk4wv\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.478741 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.478722    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-metrics-certs\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.580167 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.580057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-openshift-service-ca\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.580167 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.580112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-maas-api-tls\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.580427 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.580197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk4wv\" (UniqueName: \"kubernetes.io/projected/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-kube-api-access-kk4wv\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.580427 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.580246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-metrics-certs\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.580848 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.580819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-openshift-service-ca\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.582680 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.582655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-maas-api-tls\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.582754 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.582729    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-metrics-certs\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.587870 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.587848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk4wv\" (UniqueName: \"kubernetes.io/projected/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-kube-api-access-kk4wv\") pod \"maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.631066 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.631030    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:32.642147 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.642120    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:36:32.915390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.915348    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"]
Sep 10 19:36:32.915868 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:36:32.915840    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7565509_3d2c_4a7b_bb6d_e6f88e5a80ad.slice/crio-095c2b9f00d4c2223e52fb4380eaec7e4a490958f14b66d870a03d025ca8620d WatchSource:0}: Error finding container 095c2b9f00d4c2223e52fb4380eaec7e4a490958f14b66d870a03d025ca8620d: Status 404 returned error can't find the container with id 095c2b9f00d4c2223e52fb4380eaec7e4a490958f14b66d870a03d025ca8620d
Sep 10 19:36:32.917225 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:32.917205    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:36:33.617888 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.617862    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:36:33.674509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.674476    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh" event={"ID":"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad","Type":"ContainerStarted","Data":"fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8"}
Sep 10 19:36:33.674679 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.674633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:33.674751 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.674686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh" event={"ID":"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad","Type":"ContainerStarted","Data":"095c2b9f00d4c2223e52fb4380eaec7e4a490958f14b66d870a03d025ca8620d"}
Sep 10 19:36:33.676221 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.676195    2558 generic.go:356] "Generic (PLEG): container finished" podID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerID="858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1" exitCode=0
Sep 10 19:36:33.676313 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.676245    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"
Sep 10 19:36:33.676362 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.676241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" event={"ID":"2c79ee58-4ead-4f32-b926-bc3477eab678","Type":"ContainerDied","Data":"858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1"}
Sep 10 19:36:33.676362 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.676355    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k" event={"ID":"2c79ee58-4ead-4f32-b926-bc3477eab678","Type":"ContainerDied","Data":"02516219f32378edcf892fa9d8e1d243ffe511d1982824121f83c1910cc40f21"}
Sep 10 19:36:33.676467 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.676401    2558 scope.go:117] "RemoveContainer" containerID="858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1"
Sep 10 19:36:33.685443 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.685425    2558 scope.go:117] "RemoveContainer" containerID="c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0"
Sep 10 19:36:33.693942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.693898    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh" podStartSLOduration=1.348562735 podStartE2EDuration="1.693883122s" totalImagesPullingTime="345.320387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:36:33.69018747 +0000 UTC m=+982.506797040" watchObservedRunningTime="2026-09-10 19:36:33.693883122 +0000 UTC m=+982.510492735"
Sep 10 19:36:33.698137 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.698109    2558 scope.go:117] "RemoveContainer" containerID="858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1"
Sep 10 19:36:33.698487 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:36:33.698461    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1\": container with ID starting with 858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1 not found: ID does not exist" containerID="858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1"
Sep 10 19:36:33.698579 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.698494    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1"} err="failed to get container status \"858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1\": rpc error: code = NotFound desc = could not find container \"858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1\": container with ID starting with 858aa873cbfd5abd0c4313f9e00353e56fafcc2893c16a397eb12316e0dfa4e1 not found: ID does not exist"
Sep 10 19:36:33.698579 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.698511    2558 scope.go:117] "RemoveContainer" containerID="c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0"
Sep 10 19:36:33.698811 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:36:33.698792    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0\": container with ID starting with c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0 not found: ID does not exist" containerID="c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0"
Sep 10 19:36:33.698873 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.698820    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0"} err="failed to get container status \"c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0\": rpc error: code = NotFound desc = could not find container \"c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0\": container with ID starting with c88929c2aa1b0ec47f09d261ba211673bd8653b8e364210acbf3b867f5b7efb0 not found: ID does not exist"
Sep 10 19:36:33.794011 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.793916    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-podinfo\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794011 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.793970    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f48l\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-kube-api-access-5f48l\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794042    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-data\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-socket\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794100    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-credential-socket\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794123    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-token\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794155    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c79ee58-4ead-4f32-b926-bc3477eab678-istiod-ca-cert\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794224    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-envoy\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794259    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-certs\") pod \"2c79ee58-4ead-4f32-b926-bc3477eab678\" (UID: \"2c79ee58-4ead-4f32-b926-bc3477eab678\") "
Sep 10 19:36:33.794557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794365    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:36:33.794557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794407    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:36:33.794708 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794650    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:36:33.794768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794748    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:36:33.794849 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794822    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.794914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794850    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.794914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794864    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.794914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.794878    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.795337 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.795314    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c79ee58-4ead-4f32-b926-bc3477eab678-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:36:33.796387 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.796352    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-kube-api-access-5f48l" (OuterVolumeSpecName: "kube-api-access-5f48l") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "kube-api-access-5f48l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:36:33.796733 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.796709    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:36:33.796733 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.796720    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:36:33.796958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.796943    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c79ee58-4ead-4f32-b926-bc3477eab678" (UID: "2c79ee58-4ead-4f32-b926-bc3477eab678"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:36:33.895733 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.895701    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.895733 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.895731    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c79ee58-4ead-4f32-b926-bc3477eab678-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.895733 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.895743    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.895971 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.895754    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c79ee58-4ead-4f32-b926-bc3477eab678-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:33.895971 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:33.895768    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f48l\" (UniqueName: \"kubernetes.io/projected/2c79ee58-4ead-4f32-b926-bc3477eab678-kube-api-access-5f48l\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:36:34.007229 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:34.007195    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"]
Sep 10 19:36:34.013625 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:34.013596    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b06cf0bb-openshift-default-6b78b7496b-kz82k"]
Sep 10 19:36:35.656858 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:35.656823    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" path="/var/lib/kubelet/pods/2c79ee58-4ead-4f32-b926-bc3477eab678/volumes"
Sep 10 19:36:39.688738 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:39.688707    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:36:45.751033 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:45.751000    2558 generic.go:356] "Generic (PLEG): container finished" podID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerID="bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66" exitCode=0
Sep 10 19:36:45.751562 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:45.751069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" event={"ID":"0be00a47-1273-4434-b9e6-953da3ff97fb","Type":"ContainerDied","Data":"bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66"}
Sep 10 19:36:45.751646 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:45.751627    2558 scope.go:117] "RemoveContainer" containerID="bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66"
Sep 10 19:36:45.753063 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:45.753035    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:45.753150 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:45.753099    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:45.753150 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:45.753134    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:36:46.764103 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:46.764055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" event={"ID":"0be00a47-1273-4434-b9e6-953da3ff97fb","Type":"ContainerStarted","Data":"025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1"}
Sep 10 19:36:47.111060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:47.110978    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:47.112116 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:47.112089    2558 patch_prober.go:28] interesting pod/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 19:36:47.112252 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:47.112146    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 19:36:48.111541 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:48.111505    2558 patch_prober.go:28] interesting pod/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 19:36:48.111912 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:48.111573    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 19:36:49.110726 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:49.110681    2558 patch_prober.go:28] interesting pod/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 19:36:49.110934 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:49.110749    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 19:36:50.111510 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:50.111472    2558 patch_prober.go:28] interesting pod/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 19:36:50.111904 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:50.111542    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 19:36:51.111331 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:51.111292    2558 patch_prober.go:28] interesting pod/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 10 19:36:51.111539 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:51.111350    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 10 19:36:51.595636 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:51.595594    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:52.114606 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:52.114567    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:36:52.115533 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:36:52.115513    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:37:12.928073 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:12.928034    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"]
Sep 10 19:37:12.928554 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:12.928339    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh" podUID="d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" containerName="maas-api" containerID="cri-o://fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8" gracePeriod=30
Sep 10 19:37:13.187981 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.187913    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:37:13.295979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.295945    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-metrics-certs\") pod \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") "
Sep 10 19:37:13.296162 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.296051    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk4wv\" (UniqueName: \"kubernetes.io/projected/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-kube-api-access-kk4wv\") pod \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") "
Sep 10 19:37:13.296162 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.296091    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-maas-api-tls\") pod \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") "
Sep 10 19:37:13.296287 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.296171    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-openshift-service-ca\") pod \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\" (UID: \"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad\") "
Sep 10 19:37:13.296773 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.296712    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" (UID: "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:37:13.299227 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.299195    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-kube-api-access-kk4wv" (OuterVolumeSpecName: "kube-api-access-kk4wv") pod "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" (UID: "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad"). InnerVolumeSpecName "kube-api-access-kk4wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:37:13.299592 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.299538    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" (UID: "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:37:13.299592 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.299562    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" (UID: "d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:37:13.397442 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.397407    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk4wv\" (UniqueName: \"kubernetes.io/projected/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-kube-api-access-kk4wv\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:13.397442 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.397436    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:13.397643 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.397445    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:13.397643 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.397468    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:13.930448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.930347    2558 generic.go:356] "Generic (PLEG): container finished" podID="d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" containerID="fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8" exitCode=0
Sep 10 19:37:13.930448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.930412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh" event={"ID":"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad","Type":"ContainerDied","Data":"fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8"}
Sep 10 19:37:13.930448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.930434    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"
Sep 10 19:37:13.930981 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.930469    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh" event={"ID":"d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad","Type":"ContainerDied","Data":"095c2b9f00d4c2223e52fb4380eaec7e4a490958f14b66d870a03d025ca8620d"}
Sep 10 19:37:13.930981 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.930496    2558 scope.go:117] "RemoveContainer" containerID="fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8"
Sep 10 19:37:13.940473 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.940448    2558 scope.go:117] "RemoveContainer" containerID="fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8"
Sep 10 19:37:13.940787 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:37:13.940761    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8\": container with ID starting with fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8 not found: ID does not exist" containerID="fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8"
Sep 10 19:37:13.940855 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.940799    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8"} err="failed to get container status \"fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8\": rpc error: code = NotFound desc = could not find container \"fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8\": container with ID starting with fc205d1c5bfd932ac4829ce58a0f66b7c90d6e2bd488018740b4a46f69788de8 not found: ID does not exist"
Sep 10 19:37:13.964884 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.964851    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"]
Sep 10 19:37:13.969481 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:13.969451    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cdcbd691-69c9679b49-t2lmh"]
Sep 10 19:37:15.656520 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:15.656489    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" path="/var/lib/kubelet/pods/d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad/volumes"
Sep 10 19:37:44.708269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:44.708236    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"]
Sep 10 19:37:44.708952 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:44.708478    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn" podUID="bfd2737b-5f0a-445e-b4d5-ecaa786ee484" containerName="maas-api" containerID="cri-o://518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1" gracePeriod=30
Sep 10 19:37:44.982785 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:44.982760    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:37:45.108836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.107706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls\") pod \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") "
Sep 10 19:37:45.108836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.107790    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pl86\" (UniqueName: \"kubernetes.io/projected/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-kube-api-access-9pl86\") pod \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") "
Sep 10 19:37:45.108836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.107906    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-metrics-certs\") pod \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") "
Sep 10 19:37:45.108836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.107952    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-openshift-service-ca\") pod \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\" (UID: \"bfd2737b-5f0a-445e-b4d5-ecaa786ee484\") "
Sep 10 19:37:45.108836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.108610    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bfd2737b-5f0a-445e-b4d5-ecaa786ee484" (UID: "bfd2737b-5f0a-445e-b4d5-ecaa786ee484"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:37:45.112148 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.112119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bfd2737b-5f0a-445e-b4d5-ecaa786ee484" (UID: "bfd2737b-5f0a-445e-b4d5-ecaa786ee484"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:37:45.113321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.113289    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bfd2737b-5f0a-445e-b4d5-ecaa786ee484" (UID: "bfd2737b-5f0a-445e-b4d5-ecaa786ee484"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:37:45.115174 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.115147    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-kube-api-access-9pl86" (OuterVolumeSpecName: "kube-api-access-9pl86") pod "bfd2737b-5f0a-445e-b4d5-ecaa786ee484" (UID: "bfd2737b-5f0a-445e-b4d5-ecaa786ee484"). InnerVolumeSpecName "kube-api-access-9pl86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:37:45.115982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.115951    2558 generic.go:356] "Generic (PLEG): container finished" podID="bfd2737b-5f0a-445e-b4d5-ecaa786ee484" containerID="518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1" exitCode=0
Sep 10 19:37:45.116432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.116142    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn" event={"ID":"bfd2737b-5f0a-445e-b4d5-ecaa786ee484","Type":"ContainerDied","Data":"518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1"}
Sep 10 19:37:45.116432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.116191    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"
Sep 10 19:37:45.116432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.116234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn" event={"ID":"bfd2737b-5f0a-445e-b4d5-ecaa786ee484","Type":"ContainerDied","Data":"3a96cd84d1091958664fbfdd326b25437fc787b85c6deb7791c3f63671d7ce52"}
Sep 10 19:37:45.116432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.116268    2558 scope.go:117] "RemoveContainer" containerID="518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1"
Sep 10 19:37:45.142733 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.142713    2558 scope.go:117] "RemoveContainer" containerID="518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1"
Sep 10 19:37:45.143090 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:37:45.143065    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1\": container with ID starting with 518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1 not found: ID does not exist" containerID="518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1"
Sep 10 19:37:45.143176 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.143104    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1"} err="failed to get container status \"518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1\": rpc error: code = NotFound desc = could not find container \"518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1\": container with ID starting with 518d0ebc4ecde953489c36a7f4c3f37da080fcec57150741f06d57fb44fe4ea1 not found: ID does not exist"
Sep 10 19:37:45.151222 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.151197    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"]
Sep 10 19:37:45.154998 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.154977    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8f9c8a-ccc5f67c9-8nbjn"]
Sep 10 19:37:45.208940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.208914    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:45.208940 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.208938    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pl86\" (UniqueName: \"kubernetes.io/projected/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-kube-api-access-9pl86\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:45.209098 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.208948    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:45.209098 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.208957    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd2737b-5f0a-445e-b4d5-ecaa786ee484-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:45.656630 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:45.656597    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd2737b-5f0a-445e-b4d5-ecaa786ee484" path="/var/lib/kubelet/pods/bfd2737b-5f0a-445e-b4d5-ecaa786ee484/volumes"
Sep 10 19:37:51.593904 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:51.593868    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"]
Sep 10 19:37:51.594424 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:51.594098    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy" containerID="cri-o://025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1" gracePeriod=30
Sep 10 19:37:52.116976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.116942    2558 patch_prober.go:28] interesting pod/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:37:52.117135 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.116992    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:37:52.320689 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.320656    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"]
Sep 10 19:37:52.321111 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321094    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy"
Sep 10 19:37:52.321163 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321114    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy"
Sep 10 19:37:52.321163 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321127    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd2737b-5f0a-445e-b4d5-ecaa786ee484" containerName="maas-api"
Sep 10 19:37:52.321163 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321133    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd2737b-5f0a-445e-b4d5-ecaa786ee484" containerName="maas-api"
Sep 10 19:37:52.321163 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321150    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" containerName="maas-api"
Sep 10 19:37:52.321163 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321156    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" containerName="maas-api"
Sep 10 19:37:52.321329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321235    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy"
Sep 10 19:37:52.321329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321248    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy"
Sep 10 19:37:52.321329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321253    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd2737b-5f0a-445e-b4d5-ecaa786ee484" containerName="maas-api"
Sep 10 19:37:52.321329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.321260    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7565509-3d2c-4a7b-bb6d-e6f88e5a80ad" containerName="maas-api"
Sep 10 19:37:52.325762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.325745    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.328163 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.328141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-9947fa-openshift-default-dockercfg-55gk9\""
Sep 10 19:37:52.339094 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.339067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"]
Sep 10 19:37:52.378423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378300    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-socket\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istiod-ca-cert\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-podinfo\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-data\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-certs\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4sgx\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-kube-api-access-w4sgx\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-token\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378643    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-credential-socket\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.378710 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.378683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-envoy\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.479608 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4sgx\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-kube-api-access-w4sgx\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.479812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-token\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.479812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-credential-socket\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.479812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-envoy\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.479812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-socket\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.479812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istiod-ca-cert\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.479812 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-podinfo\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.480127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-data\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.480127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.479950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-certs\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.480212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.480158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-credential-socket\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.480212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.480183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-socket\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.480475 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.480439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-certs\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.480586 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.480454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-data\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.480586 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.480571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istiod-ca-cert\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.482117 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.482087    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-envoy\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.482251 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.482232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-podinfo\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.487350 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.487329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-token\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.487473 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.487414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4sgx\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-kube-api-access-w4sgx\") pod \"e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") " pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.638614 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.638537    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:52.923958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.923929    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"]
Sep 10 19:37:52.925637 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:37:52.925472    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab5c696_bbde_4cc3_be93_c515f2c6dc55.slice/crio-a5244f905999010a951049b6620e193517185afa9649e5614a12b5ce8230d6d5 WatchSource:0}: Error finding container a5244f905999010a951049b6620e193517185afa9649e5614a12b5ce8230d6d5: Status 404 returned error can't find the container with id a5244f905999010a951049b6620e193517185afa9649e5614a12b5ce8230d6d5
Sep 10 19:37:52.930009 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.929972    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:37:52.930107 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.930055    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:37:52.930107 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:52.930094    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:37:53.167169 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:53.167133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82" event={"ID":"dab5c696-bbde-4cc3-be93-c515f2c6dc55","Type":"ContainerStarted","Data":"7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5"}
Sep 10 19:37:53.167328 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:53.167191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82" event={"ID":"dab5c696-bbde-4cc3-be93-c515f2c6dc55","Type":"ContainerStarted","Data":"a5244f905999010a951049b6620e193517185afa9649e5614a12b5ce8230d6d5"}
Sep 10 19:37:53.190314 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:53.190270    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82" podStartSLOduration=1.190252826 podStartE2EDuration="1.190252826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:37:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:37:53.186631025 +0000 UTC m=+1062.003240595" watchObservedRunningTime="2026-09-10 19:37:53.190252826 +0000 UTC m=+1062.006862394"
Sep 10 19:37:53.639029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:53.638935    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:53.644282 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:53.644256    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:54.179014 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:54.178975    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:54.179936 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:54.179919    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:37:56.857719 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.857652    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:37:56.921746 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921718    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-data\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.921914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921753    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs4m6\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-kube-api-access-vs4m6\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.921914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921798    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-socket\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.921914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921825    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-podinfo\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.921914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921854    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be00a47-1273-4434-b9e6-953da3ff97fb-istiod-ca-cert\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.921914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921875    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-envoy\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.921914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921890    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-credential-socket\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.922233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921948    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-certs\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.922233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.921992    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-token\") pod \"0be00a47-1273-4434-b9e6-953da3ff97fb\" (UID: \"0be00a47-1273-4434-b9e6-953da3ff97fb\") "
Sep 10 19:37:56.922233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.922020    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:37:56.922233 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.922094    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:37:56.922484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.922315    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:56.922484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.922321    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:37:56.922484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.922335    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:56.922484 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.922369    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0be00a47-1273-4434-b9e6-953da3ff97fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:37:56.922672 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.922528    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:37:56.924110 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.924077    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:37:56.924221 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.924192    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:37:56.924520 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.924497    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:37:56.924593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:56.924540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-kube-api-access-vs4m6" (OuterVolumeSpecName: "kube-api-access-vs4m6") pod "0be00a47-1273-4434-b9e6-953da3ff97fb" (UID: "0be00a47-1273-4434-b9e6-953da3ff97fb"). InnerVolumeSpecName "kube-api-access-vs4m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:37:57.023768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.023731    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:57.023768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.023766    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs4m6\" (UniqueName: \"kubernetes.io/projected/0be00a47-1273-4434-b9e6-953da3ff97fb-kube-api-access-vs4m6\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:57.023768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.023778    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:57.024065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.023790    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be00a47-1273-4434-b9e6-953da3ff97fb-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:57.024065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.023802    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:57.024065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.023813    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:57.024065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.023824    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be00a47-1273-4434-b9e6-953da3ff97fb-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:37:57.197195 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.197159    2558 generic.go:356] "Generic (PLEG): container finished" podID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerID="025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1" exitCode=0
Sep 10 19:37:57.197414 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.197205    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"
Sep 10 19:37:57.197414 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.197224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" event={"ID":"0be00a47-1273-4434-b9e6-953da3ff97fb","Type":"ContainerDied","Data":"025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1"}
Sep 10 19:37:57.197414 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.197280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd" event={"ID":"0be00a47-1273-4434-b9e6-953da3ff97fb","Type":"ContainerDied","Data":"cfffccbd53a6e89089d56cc28c845194ba758469ad259e3a99372d28120193ad"}
Sep 10 19:37:57.197414 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.197309    2558 scope.go:117] "RemoveContainer" containerID="025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1"
Sep 10 19:37:57.207625 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.207605    2558 scope.go:117] "RemoveContainer" containerID="bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66"
Sep 10 19:37:57.216214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.216196    2558 scope.go:117] "RemoveContainer" containerID="025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1"
Sep 10 19:37:57.216531 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:37:57.216509    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1\": container with ID starting with 025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1 not found: ID does not exist" containerID="025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1"
Sep 10 19:37:57.216603 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.216540    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1"} err="failed to get container status \"025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1\": rpc error: code = NotFound desc = could not find container \"025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1\": container with ID starting with 025e57eb39eb48aa8a2c9eb27a1a8bb68bfc73d9312b066520061e161b90b7c1 not found: ID does not exist"
Sep 10 19:37:57.216603 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.216558    2558 scope.go:117] "RemoveContainer" containerID="bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66"
Sep 10 19:37:57.216803 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:37:57.216789    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66\": container with ID starting with bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66 not found: ID does not exist" containerID="bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66"
Sep 10 19:37:57.216850 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.216805    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66"} err="failed to get container status \"bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66\": rpc error: code = NotFound desc = could not find container \"bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66\": container with ID starting with bc3dc8ea5b851d387ee7e9f17ded1f43152d2b3370ee068d08b6dce23d6fae66 not found: ID does not exist"
Sep 10 19:37:57.218926 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.218905    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"]
Sep 10 19:37:57.221824 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.221800    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-8f9c8a-openshift-default-775c6c6b7b-67sqd"]
Sep 10 19:37:57.656542 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:37:57.656452    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" path="/var/lib/kubelet/pods/0be00a47-1273-4434-b9e6-953da3ff97fb/volumes"
Sep 10 19:38:10.974986 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:10.974909    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"]
Sep 10 19:38:10.975403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:10.975172    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82" podUID="dab5c696-bbde-4cc3-be93-c515f2c6dc55" containerName="istio-proxy" containerID="cri-o://7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5" gracePeriod=30
Sep 10 19:38:16.231071 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.231046    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:38:16.308941 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.308822    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-token\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309155 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309032    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4sgx\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-kube-api-access-w4sgx\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309155 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309078    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-socket\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309155 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309128    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-data\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309167    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-credential-socket\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309210    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-certs\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309275    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-podinfo\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309312    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-envoy\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309590 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309356    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istiod-ca-cert\") pod \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\" (UID: \"dab5c696-bbde-4cc3-be93-c515f2c6dc55\") "
Sep 10 19:38:16.309590 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309475    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:38:16.309590 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309478    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-data" (OuterVolumeSpecName: "istio-data") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:38:16.309590 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309556    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:38:16.309787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309694    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:38:16.309843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309780    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.309843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309804    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.309843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309823    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.309843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.309836    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.310044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.310013    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:38:16.311217 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311183    2558 generic.go:356] "Generic (PLEG): container finished" podID="dab5c696-bbde-4cc3-be93-c515f2c6dc55" containerID="7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5" exitCode=0
Sep 10 19:38:16.311336 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311249    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"
Sep 10 19:38:16.311336 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311271    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82" event={"ID":"dab5c696-bbde-4cc3-be93-c515f2c6dc55","Type":"ContainerDied","Data":"7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5"}
Sep 10 19:38:16.311489 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311342    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82" event={"ID":"dab5c696-bbde-4cc3-be93-c515f2c6dc55","Type":"ContainerDied","Data":"a5244f905999010a951049b6620e193517185afa9649e5614a12b5ce8230d6d5"}
Sep 10 19:38:16.311489 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311391    2558 scope.go:117] "RemoveContainer" containerID="7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5"
Sep 10 19:38:16.311874 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311849    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:38:16.311969 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311894    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:38:16.311969 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.311910    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-token" (OuterVolumeSpecName: "istio-token") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:38:16.312177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.312144    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-kube-api-access-w4sgx" (OuterVolumeSpecName: "kube-api-access-w4sgx") pod "dab5c696-bbde-4cc3-be93-c515f2c6dc55" (UID: "dab5c696-bbde-4cc3-be93-c515f2c6dc55"). InnerVolumeSpecName "kube-api-access-w4sgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:38:16.330924 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.330904    2558 scope.go:117] "RemoveContainer" containerID="7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5"
Sep 10 19:38:16.331229 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:38:16.331211    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5\": container with ID starting with 7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5 not found: ID does not exist" containerID="7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5"
Sep 10 19:38:16.331304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.331237    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5"} err="failed to get container status \"7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5\": rpc error: code = NotFound desc = could not find container \"7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5\": container with ID starting with 7a439c9760d348de22ec1f34fbf1545c2210f7e627651519aa281cd5e9aa78c5 not found: ID does not exist"
Sep 10 19:38:16.410705 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.410670    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4sgx\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-kube-api-access-w4sgx\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.410705 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.410700    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.410705 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.410710    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.410914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.410718    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.410914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.410726    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab5c696-bbde-4cc3-be93-c515f2c6dc55-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:16.633077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.633046    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"]
Sep 10 19:38:16.637132 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:16.637107    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-9947fa-openshift-default-9d64c6b7b-7mn82"]
Sep 10 19:38:17.656533 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:17.656498    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab5c696-bbde-4cc3-be93-c515f2c6dc55" path="/var/lib/kubelet/pods/dab5c696-bbde-4cc3-be93-c515f2c6dc55/volumes"
Sep 10 19:38:39.843060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:39.843014    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"]
Sep 10 19:38:39.843681 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:39.843305    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5" podUID="deb4c736-8899-4c78-a92f-00d30433c276" containerName="maas-api" containerID="cri-o://b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb" gracePeriod=30
Sep 10 19:38:40.108838 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.108777    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:38:40.147357 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.147325    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnhr9\" (UniqueName: \"kubernetes.io/projected/deb4c736-8899-4c78-a92f-00d30433c276-kube-api-access-rnhr9\") pod \"deb4c736-8899-4c78-a92f-00d30433c276\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") "
Sep 10 19:38:40.147548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.147385    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-metrics-certs\") pod \"deb4c736-8899-4c78-a92f-00d30433c276\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") "
Sep 10 19:38:40.147548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.147415    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-maas-api-tls\") pod \"deb4c736-8899-4c78-a92f-00d30433c276\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") "
Sep 10 19:38:40.147548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.147495    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deb4c736-8899-4c78-a92f-00d30433c276-openshift-service-ca\") pod \"deb4c736-8899-4c78-a92f-00d30433c276\" (UID: \"deb4c736-8899-4c78-a92f-00d30433c276\") "
Sep 10 19:38:40.147970 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.147939    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb4c736-8899-4c78-a92f-00d30433c276-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "deb4c736-8899-4c78-a92f-00d30433c276" (UID: "deb4c736-8899-4c78-a92f-00d30433c276"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:38:40.150325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.150087    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "deb4c736-8899-4c78-a92f-00d30433c276" (UID: "deb4c736-8899-4c78-a92f-00d30433c276"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:38:40.150726 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.150703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb4c736-8899-4c78-a92f-00d30433c276-kube-api-access-rnhr9" (OuterVolumeSpecName: "kube-api-access-rnhr9") pod "deb4c736-8899-4c78-a92f-00d30433c276" (UID: "deb4c736-8899-4c78-a92f-00d30433c276"). InnerVolumeSpecName "kube-api-access-rnhr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:38:40.151057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.151023    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "deb4c736-8899-4c78-a92f-00d30433c276" (UID: "deb4c736-8899-4c78-a92f-00d30433c276"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:38:40.248822 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.248783    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnhr9\" (UniqueName: \"kubernetes.io/projected/deb4c736-8899-4c78-a92f-00d30433c276-kube-api-access-rnhr9\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:40.249015 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.248841    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:40.249015 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.248856    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/deb4c736-8899-4c78-a92f-00d30433c276-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:40.249015 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.248869    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/deb4c736-8899-4c78-a92f-00d30433c276-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:40.447974 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.447937    2558 generic.go:356] "Generic (PLEG): container finished" podID="deb4c736-8899-4c78-a92f-00d30433c276" containerID="b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb" exitCode=0
Sep 10 19:38:40.448179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.447987    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"
Sep 10 19:38:40.448179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.448026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5" event={"ID":"deb4c736-8899-4c78-a92f-00d30433c276","Type":"ContainerDied","Data":"b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb"}
Sep 10 19:38:40.448179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.448096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5" event={"ID":"deb4c736-8899-4c78-a92f-00d30433c276","Type":"ContainerDied","Data":"3a9b5282aa689a2378ae8bb3ef32bda4162b17cab804fa61e82045ac6a827e3e"}
Sep 10 19:38:40.448179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.448128    2558 scope.go:117] "RemoveContainer" containerID="b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb"
Sep 10 19:38:40.458031 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.458011    2558 scope.go:117] "RemoveContainer" containerID="b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb"
Sep 10 19:38:40.458290 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:38:40.458273    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb\": container with ID starting with b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb not found: ID does not exist" containerID="b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb"
Sep 10 19:38:40.458329 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.458300    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb"} err="failed to get container status \"b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb\": rpc error: code = NotFound desc = could not find container \"b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb\": container with ID starting with b5b2fe22916e8e047634c45d0f043e82eb0c4a90d38f45b57c88b540eefa0ffb not found: ID does not exist"
Sep 10 19:38:40.474943 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.474918    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"]
Sep 10 19:38:40.478140 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:40.478120    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1590-7478667fb6-lz4r5"]
Sep 10 19:38:41.656308 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:41.656271    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb4c736-8899-4c78-a92f-00d30433c276" path="/var/lib/kubelet/pods/deb4c736-8899-4c78-a92f-00d30433c276/volumes"
Sep 10 19:38:50.584765 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.584732    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"]
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585138    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585150    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585161    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab5c696-bbde-4cc3-be93-c515f2c6dc55" containerName="istio-proxy"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585168    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab5c696-bbde-4cc3-be93-c515f2c6dc55" containerName="istio-proxy"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585180    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585186    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585196    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb4c736-8899-4c78-a92f-00d30433c276" containerName="maas-api"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585202    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb4c736-8899-4c78-a92f-00d30433c276" containerName="maas-api"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585213    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy"
Sep 10 19:38:50.585218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585218    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c79ee58-4ead-4f32-b926-bc3477eab678" containerName="istio-proxy"
Sep 10 19:38:50.585545 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585278    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy"
Sep 10 19:38:50.585545 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585286    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be00a47-1273-4434-b9e6-953da3ff97fb" containerName="istio-proxy"
Sep 10 19:38:50.585545 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585294    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb4c736-8899-4c78-a92f-00d30433c276" containerName="maas-api"
Sep 10 19:38:50.585545 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.585301    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab5c696-bbde-4cc3-be93-c515f2c6dc55" containerName="istio-proxy"
Sep 10 19:38:50.589834 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.589810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.592078 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.592053    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f5248185-openshift-default-dockercfg-qcl7j\""
Sep 10 19:38:50.601817 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.601794    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"]
Sep 10 19:38:50.639835 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.639803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-envoy\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.639835 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.639837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-token\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.640044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.639864    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-credential-socket\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.640044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.639990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d95625b-5e26-48f4-b8bd-2795aca1b695-istiod-ca-cert\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.640044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.640031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbdn\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-kube-api-access-vzbdn\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.640199 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.640126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-certs\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.640238 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.640196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-podinfo\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.640288 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.640238    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-data\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.640288 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.640279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-socket\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741130 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-envoy\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741139    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-token\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-credential-socket\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d95625b-5e26-48f4-b8bd-2795aca1b695-istiod-ca-cert\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbdn\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-kube-api-access-vzbdn\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-certs\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-podinfo\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-data\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-socket\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741757    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-certs\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741832 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-credential-socket\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.741968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-data\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.742030 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.741993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-socket\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.742427 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.742402    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d95625b-5e26-48f4-b8bd-2795aca1b695-istiod-ca-cert\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.743890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.743867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-envoy\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.744399 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.744355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-podinfo\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.748840 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.748814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-token\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.749032 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.749015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbdn\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-kube-api-access-vzbdn\") pod \"e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") " pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:50.901692 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:50.901594    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:51.181167 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.181135    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"]
Sep 10 19:38:51.182967 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:38:51.182942    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d95625b_5e26_48f4_b8bd_2795aca1b695.slice/crio-a02d6692dedcda49e0fa6642a2bc984d245058558f84f94dd78ab19a2a4d4cba WatchSource:0}: Error finding container a02d6692dedcda49e0fa6642a2bc984d245058558f84f94dd78ab19a2a4d4cba: Status 404 returned error can't find the container with id a02d6692dedcda49e0fa6642a2bc984d245058558f84f94dd78ab19a2a4d4cba
Sep 10 19:38:51.185317 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.185286    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:38:51.185409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.185349    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:38:51.185409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.185396    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:38:51.510530 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.510487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" event={"ID":"3d95625b-5e26-48f4-b8bd-2795aca1b695","Type":"ContainerStarted","Data":"e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a"}
Sep 10 19:38:51.510739 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.510548    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" event={"ID":"3d95625b-5e26-48f4-b8bd-2795aca1b695","Type":"ContainerStarted","Data":"a02d6692dedcda49e0fa6642a2bc984d245058558f84f94dd78ab19a2a4d4cba"}
Sep 10 19:38:51.530988 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.530936    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podStartSLOduration=1.530921658 podStartE2EDuration="1.530921658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:38:51.528452484 +0000 UTC m=+1120.345062070" watchObservedRunningTime="2026-09-10 19:38:51.530921658 +0000 UTC m=+1120.347531257"
Sep 10 19:38:51.902276 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:51.902194    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:52.907126 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:52.907094    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:53.522005 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:53.521978    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:53.523110 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:53.523088    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:38:54.716402 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.716346    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"]
Sep 10 19:38:54.720296 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.720271    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.723119 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.723095    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f5248185-serving-cert\""
Sep 10 19:38:54.734585 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.734560    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"]
Sep 10 19:38:54.781608 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.781574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwflh\" (UniqueName: \"kubernetes.io/projected/1f052671-3d7c-4a85-97ff-17954661b865-kube-api-access-hwflh\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.781768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.781703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.781768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.781739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f052671-3d7c-4a85-97ff-17954661b865-openshift-service-ca\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.781768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.781766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-metrics-certs\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.882280 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.882246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwflh\" (UniqueName: \"kubernetes.io/projected/1f052671-3d7c-4a85-97ff-17954661b865-kube-api-access-hwflh\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.882493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.882332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.882493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.882358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f052671-3d7c-4a85-97ff-17954661b865-openshift-service-ca\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.882493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.882406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-metrics-certs\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.882493 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:38:54.882488    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-serving-cert: secret "maas-api-e2e-mt-f5248185-serving-cert" not found
Sep 10 19:38:54.882724 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:38:54.882560    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls podName:1f052671-3d7c-4a85-97ff-17954661b865 nodeName:}" failed. No retries permitted until 2026-09-10 19:38:55.382539887 +0000 UTC m=+1124.199149438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls") pod "maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw" (UID: "1f052671-3d7c-4a85-97ff-17954661b865") : secret "maas-api-e2e-mt-f5248185-serving-cert" not found
Sep 10 19:38:54.883061 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.883036    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f052671-3d7c-4a85-97ff-17954661b865-openshift-service-ca\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.884788 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.884767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-metrics-certs\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:54.891078 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:54.891055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwflh\" (UniqueName: \"kubernetes.io/projected/1f052671-3d7c-4a85-97ff-17954661b865-kube-api-access-hwflh\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:55.386859 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:55.386824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:55.389288 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:55.389260    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls\") pod \"maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:55.631100 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:55.631059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:55.911393 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:55.908515    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"]
Sep 10 19:38:55.914208 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:38:55.914149    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f052671_3d7c_4a85_97ff_17954661b865.slice/crio-82cb4d42b6d5349b625e793230193e395d2a8f958e24caf08b6aa2b5aaea696f WatchSource:0}: Error finding container 82cb4d42b6d5349b625e793230193e395d2a8f958e24caf08b6aa2b5aaea696f: Status 404 returned error can't find the container with id 82cb4d42b6d5349b625e793230193e395d2a8f958e24caf08b6aa2b5aaea696f
Sep 10 19:38:56.539630 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:56.539592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw" event={"ID":"1f052671-3d7c-4a85-97ff-17954661b865","Type":"ContainerStarted","Data":"0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76"}
Sep 10 19:38:56.539798 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:56.539661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:38:56.539798 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:56.539687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw" event={"ID":"1f052671-3d7c-4a85-97ff-17954661b865","Type":"ContainerStarted","Data":"82cb4d42b6d5349b625e793230193e395d2a8f958e24caf08b6aa2b5aaea696f"}
Sep 10 19:38:56.560120 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:56.560060    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw" podStartSLOduration=2.080637185 podStartE2EDuration="2.560044172s" totalImagesPullingTime="479.406987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:38:56.557851704 +0000 UTC m=+1125.374461299" watchObservedRunningTime="2026-09-10 19:38:56.560044172 +0000 UTC m=+1125.376653741"
Sep 10 19:38:58.060072 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.060033    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"]
Sep 10 19:38:58.060555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.060281    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq" podUID="3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" containerName="maas-api" containerID="cri-o://13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2" gracePeriod=30
Sep 10 19:38:58.319170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.319106    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:38:58.417563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.417533    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls\") pod \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") "
Sep 10 19:38:58.417735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.417609    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-openshift-service-ca\") pod \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") "
Sep 10 19:38:58.417735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.417651    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-metrics-certs\") pod \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") "
Sep 10 19:38:58.417735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.417682    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmjfb\" (UniqueName: \"kubernetes.io/projected/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-kube-api-access-vmjfb\") pod \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\" (UID: \"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72\") "
Sep 10 19:38:58.418024 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.417993    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" (UID: "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:38:58.419810 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.419784    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" (UID: "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:38:58.419937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.419853    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-kube-api-access-vmjfb" (OuterVolumeSpecName: "kube-api-access-vmjfb") pod "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" (UID: "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72"). InnerVolumeSpecName "kube-api-access-vmjfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:38:58.419937 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.419891    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" (UID: "3811db2d-0d5f-4fcb-ad90-163ebe3c0c72"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:38:58.519369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.519334    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:58.519369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.519364    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:58.519597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.519408    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmjfb\" (UniqueName: \"kubernetes.io/projected/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-kube-api-access-vmjfb\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:58.519597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.519421    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:38:58.551736 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.551704    2558 generic.go:356] "Generic (PLEG): container finished" podID="3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" containerID="13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2" exitCode=0
Sep 10 19:38:58.551923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.551765    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"
Sep 10 19:38:58.551923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.551791    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq" event={"ID":"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72","Type":"ContainerDied","Data":"13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2"}
Sep 10 19:38:58.551923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.551842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq" event={"ID":"3811db2d-0d5f-4fcb-ad90-163ebe3c0c72","Type":"ContainerDied","Data":"c06d6d1d6b0078bb53cce0c00389ad43f9329b2063c4ba87af12a1906d0ce2de"}
Sep 10 19:38:58.551923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.551872    2558 scope.go:117] "RemoveContainer" containerID="13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2"
Sep 10 19:38:58.561504 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.561491    2558 scope.go:117] "RemoveContainer" containerID="13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2"
Sep 10 19:38:58.561759 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:38:58.561742    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2\": container with ID starting with 13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2 not found: ID does not exist" containerID="13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2"
Sep 10 19:38:58.561805 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.561767    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2"} err="failed to get container status \"13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2\": rpc error: code = NotFound desc = could not find container \"13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2\": container with ID starting with 13a04de31f8ebb61ab263d600dc5e31a44af1df62f3cf4988c98c9bb2c4274e2 not found: ID does not exist"
Sep 10 19:38:58.587817 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.587739    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"]
Sep 10 19:38:58.590064 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:58.590043    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a037c8-5b9f499bfd-2kwpq"]
Sep 10 19:38:59.655622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:38:59.655583    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" path="/var/lib/kubelet/pods/3811db2d-0d5f-4fcb-ad90-163ebe3c0c72/volumes"
Sep 10 19:39:02.554687 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:02.554647    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:39:09.563570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.563531    2558 patch_prober.go:28] interesting pod/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 19:39:09.563953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.563608    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 19:39:09.731747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.731714    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"]
Sep 10 19:39:09.732156 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.732142    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" containerName="maas-api"
Sep 10 19:39:09.732201 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.732158    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" containerName="maas-api"
Sep 10 19:39:09.732585 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.732237    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3811db2d-0d5f-4fcb-ad90-163ebe3c0c72" containerName="maas-api"
Sep 10 19:39:09.735133 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.734548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.736871 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.736848    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-07c5fe-serving-cert\""
Sep 10 19:39:09.748402 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.748351    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"]
Sep 10 19:39:09.843746 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.843655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfkfb\" (UniqueName: \"kubernetes.io/projected/3273021d-e959-4628-86a7-dac7b887ac74-kube-api-access-pfkfb\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.843746 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.843719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3273021d-e959-4628-86a7-dac7b887ac74-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.844037 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.843805    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.844037 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.843854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.945024 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.944987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.945214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.945064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.945214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.945105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfkfb\" (UniqueName: \"kubernetes.io/projected/3273021d-e959-4628-86a7-dac7b887ac74-kube-api-access-pfkfb\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.945214 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.945141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3273021d-e959-4628-86a7-dac7b887ac74-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.945822 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.945797    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3273021d-e959-4628-86a7-dac7b887ac74-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.947647 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.947617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.947747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.947696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:09.952802 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:09.952781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfkfb\" (UniqueName: \"kubernetes.io/projected/3273021d-e959-4628-86a7-dac7b887ac74-kube-api-access-pfkfb\") pod \"maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:10.070244 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.070189    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:10.343796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.343774    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"]
Sep 10 19:39:10.346278 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:39:10.346247    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3273021d_e959_4628_86a7_dac7b887ac74.slice/crio-cb343e1b4bf03d4c17c271a34c374251ef1993e1f8d8ba9f77447c309240c283 WatchSource:0}: Error finding container cb343e1b4bf03d4c17c271a34c374251ef1993e1f8d8ba9f77447c309240c283: Status 404 returned error can't find the container with id cb343e1b4bf03d4c17c271a34c374251ef1993e1f8d8ba9f77447c309240c283
Sep 10 19:39:10.626634 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.626600    2558 generic.go:356] "Generic (PLEG): container finished" podID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerID="e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a" exitCode=0
Sep 10 19:39:10.627041 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.626675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" event={"ID":"3d95625b-5e26-48f4-b8bd-2795aca1b695","Type":"ContainerDied","Data":"e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a"}
Sep 10 19:39:10.627151 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.627135    2558 scope.go:117] "RemoveContainer" containerID="e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a"
Sep 10 19:39:10.627927 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.627909    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t" event={"ID":"3273021d-e959-4628-86a7-dac7b887ac74","Type":"ContainerStarted","Data":"cb343e1b4bf03d4c17c271a34c374251ef1993e1f8d8ba9f77447c309240c283"}
Sep 10 19:39:10.628709 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.628683    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:39:10.628783 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.628766    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:39:10.628844 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:10.628811    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:39:11.636690 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:11.636646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" event={"ID":"3d95625b-5e26-48f4-b8bd-2795aca1b695","Type":"ContainerStarted","Data":"a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068"}
Sep 10 19:39:11.638218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:11.638192    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t" event={"ID":"3273021d-e959-4628-86a7-dac7b887ac74","Type":"ContainerStarted","Data":"27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958"}
Sep 10 19:39:11.638357 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:11.638251    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:11.688452 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:11.688358    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t" podStartSLOduration=2.4072275100000002 podStartE2EDuration="2.688339681s" totalImagesPullingTime="281.112171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:39:11.688196147 +0000 UTC m=+1140.504805744" watchObservedRunningTime="2026-09-10 19:39:11.688339681 +0000 UTC m=+1140.504949250"
Sep 10 19:39:11.902486 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:11.902401    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:39:11.902626 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:11.902607    2558 patch_prober.go:28] interesting pod/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 19:39:11.902669 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:11.902653    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 19:39:12.902280 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:12.902241    2558 patch_prober.go:28] interesting pod/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 19:39:12.902782 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:12.902300    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 19:39:13.902629 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:13.902591    2558 patch_prober.go:28] interesting pod/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 19:39:13.903031 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:13.902647    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 19:39:14.902738 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:14.902699    2558 patch_prober.go:28] interesting pod/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 19:39:14.903216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:14.902777    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 19:39:15.902786 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:15.902748    2558 patch_prober.go:28] interesting pod/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 19:39:15.903175 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:15.902813    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 19:39:16.905534 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:16.905503    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:39:16.905921 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:16.905897    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:39:16.906626 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:16.906610    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:39:17.661570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:17.661533    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:39:36.477848 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.477760    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"]
Sep 10 19:39:36.478424 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.478121    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw" podUID="1f052671-3d7c-4a85-97ff-17954661b865" containerName="maas-api" containerID="cri-o://0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76" gracePeriod=30
Sep 10 19:39:36.729830 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.729776    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:39:36.796412 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.796356    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f052671-3d7c-4a85-97ff-17954661b865" containerID="0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76" exitCode=0
Sep 10 19:39:36.796593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.796426    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"
Sep 10 19:39:36.796593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.796426    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw" event={"ID":"1f052671-3d7c-4a85-97ff-17954661b865","Type":"ContainerDied","Data":"0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76"}
Sep 10 19:39:36.796593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.796497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw" event={"ID":"1f052671-3d7c-4a85-97ff-17954661b865","Type":"ContainerDied","Data":"82cb4d42b6d5349b625e793230193e395d2a8f958e24caf08b6aa2b5aaea696f"}
Sep 10 19:39:36.796593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.796536    2558 scope.go:117] "RemoveContainer" containerID="0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76"
Sep 10 19:39:36.807291 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.807269    2558 scope.go:117] "RemoveContainer" containerID="0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76"
Sep 10 19:39:36.807630 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:39:36.807610    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76\": container with ID starting with 0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76 not found: ID does not exist" containerID="0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76"
Sep 10 19:39:36.807693 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.807638    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76"} err="failed to get container status \"0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76\": rpc error: code = NotFound desc = could not find container \"0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76\": container with ID starting with 0f96e436004e2dfee1cd6bf72b1bb0c5f411cb57a44a4f390b5bb585d5107c76 not found: ID does not exist"
Sep 10 19:39:36.812966 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.812946    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f052671-3d7c-4a85-97ff-17954661b865-openshift-service-ca\") pod \"1f052671-3d7c-4a85-97ff-17954661b865\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") "
Sep 10 19:39:36.813048 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.813005    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-metrics-certs\") pod \"1f052671-3d7c-4a85-97ff-17954661b865\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") "
Sep 10 19:39:36.813128 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.813111    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls\") pod \"1f052671-3d7c-4a85-97ff-17954661b865\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") "
Sep 10 19:39:36.813202 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.813178    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwflh\" (UniqueName: \"kubernetes.io/projected/1f052671-3d7c-4a85-97ff-17954661b865-kube-api-access-hwflh\") pod \"1f052671-3d7c-4a85-97ff-17954661b865\" (UID: \"1f052671-3d7c-4a85-97ff-17954661b865\") "
Sep 10 19:39:36.813344 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.813325    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f052671-3d7c-4a85-97ff-17954661b865-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f052671-3d7c-4a85-97ff-17954661b865" (UID: "1f052671-3d7c-4a85-97ff-17954661b865"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:39:36.813632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.813610    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f052671-3d7c-4a85-97ff-17954661b865-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:36.815146 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.815123    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f052671-3d7c-4a85-97ff-17954661b865" (UID: "1f052671-3d7c-4a85-97ff-17954661b865"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:39:36.815234 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.815218    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f052671-3d7c-4a85-97ff-17954661b865" (UID: "1f052671-3d7c-4a85-97ff-17954661b865"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:39:36.815277 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.815228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f052671-3d7c-4a85-97ff-17954661b865-kube-api-access-hwflh" (OuterVolumeSpecName: "kube-api-access-hwflh") pod "1f052671-3d7c-4a85-97ff-17954661b865" (UID: "1f052671-3d7c-4a85-97ff-17954661b865"). InnerVolumeSpecName "kube-api-access-hwflh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:39:36.914838 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.914803    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:36.914838 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.914830    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f052671-3d7c-4a85-97ff-17954661b865-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:36.914838 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:36.914840    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwflh\" (UniqueName: \"kubernetes.io/projected/1f052671-3d7c-4a85-97ff-17954661b865-kube-api-access-hwflh\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:37.118178 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:37.118146    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"]
Sep 10 19:39:37.123037 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:37.123013    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5248185-655bbf58dd-vtxjw"]
Sep 10 19:39:37.656847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:37.656813    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f052671-3d7c-4a85-97ff-17954661b865" path="/var/lib/kubelet/pods/1f052671-3d7c-4a85-97ff-17954661b865/volumes"
Sep 10 19:39:38.037902 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.037872    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"]
Sep 10 19:39:38.038309 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.038294    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f052671-3d7c-4a85-97ff-17954661b865" containerName="maas-api"
Sep 10 19:39:38.038309 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.038309    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f052671-3d7c-4a85-97ff-17954661b865" containerName="maas-api"
Sep 10 19:39:38.038493 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.038389    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f052671-3d7c-4a85-97ff-17954661b865" containerName="maas-api"
Sep 10 19:39:38.041448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.041426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.045509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.045285    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-2a1fa9-serving-cert\""
Sep 10 19:39:38.053040 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.052928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"]
Sep 10 19:39:38.126588 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.126557    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.126735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.126599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgnkj\" (UniqueName: \"kubernetes.io/projected/88167b78-1c33-47bf-9f70-5a139de2b02f-kube-api-access-tgnkj\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.126735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.126677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.126735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.126710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88167b78-1c33-47bf-9f70-5a139de2b02f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.228218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.228187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.228432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.228228    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgnkj\" (UniqueName: \"kubernetes.io/projected/88167b78-1c33-47bf-9f70-5a139de2b02f-kube-api-access-tgnkj\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.228432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.228352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.228432 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:39:38.228366    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-serving-cert: secret "maas-api-e2e-shared-b-w3-2a1fa9-serving-cert" not found
Sep 10 19:39:38.228432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.228421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88167b78-1c33-47bf-9f70-5a139de2b02f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.228635 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:39:38.228474    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls podName:88167b78-1c33-47bf-9f70-5a139de2b02f nodeName:}" failed. No retries permitted until 2026-09-10 19:39:38.728443917 +0000 UTC m=+1167.545053483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls") pod "maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" (UID: "88167b78-1c33-47bf-9f70-5a139de2b02f") : secret "maas-api-e2e-shared-b-w3-2a1fa9-serving-cert" not found
Sep 10 19:39:38.229076 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.229059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88167b78-1c33-47bf-9f70-5a139de2b02f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.230678 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.230660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.239409 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.239369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgnkj\" (UniqueName: \"kubernetes.io/projected/88167b78-1c33-47bf-9f70-5a139de2b02f-kube-api-access-tgnkj\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.734604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.734568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.737245 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.737213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:38.955176 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:38.955138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:39.226756 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:39.226724    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"]
Sep 10 19:39:39.228031 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:39:39.228004    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88167b78_1c33_47bf_9f70_5a139de2b02f.slice/crio-c2de2bf576a22aab60e987fd1dcede14cae2b8f6445d909579d142b1045918ca WatchSource:0}: Error finding container c2de2bf576a22aab60e987fd1dcede14cae2b8f6445d909579d142b1045918ca: Status 404 returned error can't find the container with id c2de2bf576a22aab60e987fd1dcede14cae2b8f6445d909579d142b1045918ca
Sep 10 19:39:39.816283 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:39.816178    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" event={"ID":"88167b78-1c33-47bf-9f70-5a139de2b02f","Type":"ContainerStarted","Data":"3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538"}
Sep 10 19:39:39.816283 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:39.816232    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" event={"ID":"88167b78-1c33-47bf-9f70-5a139de2b02f","Type":"ContainerStarted","Data":"c2de2bf576a22aab60e987fd1dcede14cae2b8f6445d909579d142b1045918ca"}
Sep 10 19:39:39.816745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:39.816393    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:39.833117 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:39.833069    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" podStartSLOduration=1.502569051 podStartE2EDuration="1.833052276s" totalImagesPullingTime="330.483225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:39:39.831357037 +0000 UTC m=+1168.647966621" watchObservedRunningTime="2026-09-10 19:39:39.833052276 +0000 UTC m=+1168.649661845"
Sep 10 19:39:43.227226 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:43.227191    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"]
Sep 10 19:39:43.227678 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:43.227419    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" containerID="cri-o://a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068" gracePeriod=30
Sep 10 19:39:45.826844 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:45.826816    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:39:46.908392 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:46.908343    2558 patch_prober.go:28] interesting pod/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:39:46.908768 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:46.908421    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:39:48.484885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.484859    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:39:48.527140 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527055    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-envoy\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527140 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527114    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d95625b-5e26-48f4-b8bd-2795aca1b695-istiod-ca-cert\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527363 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-podinfo\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527363 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527170    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-certs\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527363 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527206    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-socket\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527576 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:39:48.527637 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527584    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:39:48.527637 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527597    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d95625b-5e26-48f4-b8bd-2795aca1b695-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:39:48.527745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527647    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-data\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527695    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-token\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527745 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527721    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzbdn\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-kube-api-access-vzbdn\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.527913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.527763    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-credential-socket\") pod \"3d95625b-5e26-48f4-b8bd-2795aca1b695\" (UID: \"3d95625b-5e26-48f4-b8bd-2795aca1b695\") "
Sep 10 19:39:48.528120 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.528094    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:39:48.528212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.528122    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d95625b-5e26-48f4-b8bd-2795aca1b695-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.528212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.528139    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.528212 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.528148    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.528412 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.528234    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:39:48.529563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.529535    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:39:48.529883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.529859    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:39:48.530284 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.530264    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:39:48.530393 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.530280    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-kube-api-access-vzbdn" (OuterVolumeSpecName: "kube-api-access-vzbdn") pod "3d95625b-5e26-48f4-b8bd-2795aca1b695" (UID: "3d95625b-5e26-48f4-b8bd-2795aca1b695"). InnerVolumeSpecName "kube-api-access-vzbdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:39:48.628898 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.628858    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.628898 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.628890    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.628898 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.628902    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzbdn\" (UniqueName: \"kubernetes.io/projected/3d95625b-5e26-48f4-b8bd-2795aca1b695-kube-api-access-vzbdn\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.629135 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.628914    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.629135 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.628926    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.629135 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.628937    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d95625b-5e26-48f4-b8bd-2795aca1b695-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:39:48.869587 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.869508    2558 generic.go:356] "Generic (PLEG): container finished" podID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerID="a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068" exitCode=0
Sep 10 19:39:48.869587 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.869552    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" event={"ID":"3d95625b-5e26-48f4-b8bd-2795aca1b695","Type":"ContainerDied","Data":"a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068"}
Sep 10 19:39:48.869587 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.869561    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"
Sep 10 19:39:48.869807 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.869595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4" event={"ID":"3d95625b-5e26-48f4-b8bd-2795aca1b695","Type":"ContainerDied","Data":"a02d6692dedcda49e0fa6642a2bc984d245058558f84f94dd78ab19a2a4d4cba"}
Sep 10 19:39:48.869807 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.869615    2558 scope.go:117] "RemoveContainer" containerID="a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068"
Sep 10 19:39:48.879478 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.879460    2558 scope.go:117] "RemoveContainer" containerID="e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a"
Sep 10 19:39:48.887651 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.887633    2558 scope.go:117] "RemoveContainer" containerID="a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068"
Sep 10 19:39:48.887915 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:39:48.887894    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068\": container with ID starting with a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068 not found: ID does not exist" containerID="a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068"
Sep 10 19:39:48.887986 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.887927    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068"} err="failed to get container status \"a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068\": rpc error: code = NotFound desc = could not find container \"a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068\": container with ID starting with a639e7339cbf29a2cef16569c9668af17d3d584ec119dfc116d86261a92ad068 not found: ID does not exist"
Sep 10 19:39:48.887986 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.887950    2558 scope.go:117] "RemoveContainer" containerID="e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a"
Sep 10 19:39:48.888228 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:39:48.888209    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a\": container with ID starting with e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a not found: ID does not exist" containerID="e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a"
Sep 10 19:39:48.888265 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.888234    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a"} err="failed to get container status \"e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a\": rpc error: code = NotFound desc = could not find container \"e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a\": container with ID starting with e07e2bbd167520e67193aff1f2fc59c88695ec626b8ab24f11eb92f365dcf78a not found: ID does not exist"
Sep 10 19:39:48.893910 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.893888    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"]
Sep 10 19:39:48.898076 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:48.898055    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f5248185-openshift-default-54d9884b96-sfwq4"]
Sep 10 19:39:49.655646 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:49.655613    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" path="/var/lib/kubelet/pods/3d95625b-5e26-48f4-b8bd-2795aca1b695/volumes"
Sep 10 19:39:57.269362 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.269328    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"]
Sep 10 19:39:57.269821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.269803    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy"
Sep 10 19:39:57.269881 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.269824    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy"
Sep 10 19:39:57.269881 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.269838    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy"
Sep 10 19:39:57.269881 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.269844    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy"
Sep 10 19:39:57.270039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.269917    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy"
Sep 10 19:39:57.270039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.269926    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d95625b-5e26-48f4-b8bd-2795aca1b695" containerName="istio-proxy"
Sep 10 19:39:57.274703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.274681    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.276863 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.276841    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-ecadb8-openshift-default-dockercfg-kt2gq\""
Sep 10 19:39:57.285670 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.285643    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"]
Sep 10 19:39:57.306136 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-credential-socket\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306278 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-podinfo\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306278 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-certs\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306352 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-token\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306352 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-data\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306434 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-socket\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306434 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istiod-ca-cert\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306520 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-envoy\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.306560 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.306535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvm7\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-kube-api-access-4pvm7\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-data\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-socket\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istiod-ca-cert\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-envoy\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvm7\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-kube-api-access-4pvm7\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407453    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-credential-socket\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-podinfo\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407558 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407541    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-certs\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-token\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-data\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.407878 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.407833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-socket\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.408181 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.408149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-credential-socket\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.408311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.408197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-certs\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.408311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.408219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istiod-ca-cert\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.409891 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.409861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-envoy\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.410009 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.409992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-podinfo\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.415273 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.415243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-token\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.415419 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.415402    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvm7\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-kube-api-access-4pvm7\") pod \"e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") " pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.586842 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.586755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:57.875103 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.875071    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"]
Sep 10 19:39:57.876430 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:39:57.876402    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95affc8c_27b4_41fb_9a10_eee9cf3eb406.slice/crio-165188d27cec3491138dc827b687a8c7bd6c00e5c3c432daa07431cdb3ba4fd3 WatchSource:0}: Error finding container 165188d27cec3491138dc827b687a8c7bd6c00e5c3c432daa07431cdb3ba4fd3: Status 404 returned error can't find the container with id 165188d27cec3491138dc827b687a8c7bd6c00e5c3c432daa07431cdb3ba4fd3
Sep 10 19:39:57.878632 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.878599    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:39:57.878712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.878665    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:39:57.878712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.878697    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:39:57.922187 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:57.922157    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" event={"ID":"95affc8c-27b4-41fb-9a10-eee9cf3eb406","Type":"ContainerStarted","Data":"165188d27cec3491138dc827b687a8c7bd6c00e5c3c432daa07431cdb3ba4fd3"}
Sep 10 19:39:58.929828 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:58.929789    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" event={"ID":"95affc8c-27b4-41fb-9a10-eee9cf3eb406","Type":"ContainerStarted","Data":"dd024cc58c1b67a76a631d09a86e41d5a8950d31b005926d3395cac28f0bee1f"}
Sep 10 19:39:58.955789 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:58.955740    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podStartSLOduration=1.955721217 podStartE2EDuration="1.955721217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:39:58.953350632 +0000 UTC m=+1187.769960218" watchObservedRunningTime="2026-09-10 19:39:58.955721217 +0000 UTC m=+1187.772330787"
Sep 10 19:39:59.587331 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:59.587285    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:59.592530 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:59.592506    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:59.936181 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:59.936104    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:39:59.937069 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:39:59.937052    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:40:02.136677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.136638    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"]
Sep 10 19:40:02.140570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.140545    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.143119 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.143078    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-ecadb8-serving-cert\""
Sep 10 19:40:02.163125 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.163087    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"]
Sep 10 19:40:02.253821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.253781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4cc443-e25f-48e3-8c13-e74b00defa5c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.254025 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.253842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.254025 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.253902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.254025 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.253948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4nlg\" (UniqueName: \"kubernetes.io/projected/bb4cc443-e25f-48e3-8c13-e74b00defa5c-kube-api-access-l4nlg\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.355411 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.355349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4nlg\" (UniqueName: \"kubernetes.io/projected/bb4cc443-e25f-48e3-8c13-e74b00defa5c-kube-api-access-l4nlg\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.355593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.355524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4cc443-e25f-48e3-8c13-e74b00defa5c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.355593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.355561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.355728 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.355709    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.355810 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:40:02.355790    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-serving-cert: secret "maas-api-e2e-shared-a-w2-ecadb8-serving-cert" not found
Sep 10 19:40:02.355892 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:40:02.355879    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls podName:bb4cc443-e25f-48e3-8c13-e74b00defa5c nodeName:}" failed. No retries permitted until 2026-09-10 19:40:02.855855888 +0000 UTC m=+1191.672465451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls") pod "maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9" (UID: "bb4cc443-e25f-48e3-8c13-e74b00defa5c") : secret "maas-api-e2e-shared-a-w2-ecadb8-serving-cert" not found
Sep 10 19:40:02.356259 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.356238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4cc443-e25f-48e3-8c13-e74b00defa5c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.358056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.358033    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.365638 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.365617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4nlg\" (UniqueName: \"kubernetes.io/projected/bb4cc443-e25f-48e3-8c13-e74b00defa5c-kube-api-access-l4nlg\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.861860 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.861826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:02.864388 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:02.864346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:03.055066 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:03.055028    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:03.336027 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:03.336002    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"]
Sep 10 19:40:03.336862 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:40:03.336832    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4cc443_e25f_48e3_8c13_e74b00defa5c.slice/crio-342843d74d14d732b3e77fd97c128d5fdd4c496e8dee2482780da5f3201d23e9 WatchSource:0}: Error finding container 342843d74d14d732b3e77fd97c128d5fdd4c496e8dee2482780da5f3201d23e9: Status 404 returned error can't find the container with id 342843d74d14d732b3e77fd97c128d5fdd4c496e8dee2482780da5f3201d23e9
Sep 10 19:40:03.964100 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:03.964054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9" event={"ID":"bb4cc443-e25f-48e3-8c13-e74b00defa5c","Type":"ContainerStarted","Data":"342843d74d14d732b3e77fd97c128d5fdd4c496e8dee2482780da5f3201d23e9"}
Sep 10 19:40:04.971117 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:04.971080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9" event={"ID":"bb4cc443-e25f-48e3-8c13-e74b00defa5c","Type":"ContainerStarted","Data":"862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4"}
Sep 10 19:40:04.971554 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:04.971213    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:04.989186 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:04.989128    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9" podStartSLOduration=2.287434841 podStartE2EDuration="2.989113184s" totalImagesPullingTime="701.678343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:40:04.987785216 +0000 UTC m=+1193.804394785" watchObservedRunningTime="2026-09-10 19:40:04.989113184 +0000 UTC m=+1193.805722752"
Sep 10 19:40:10.982825 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:10.982788    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:40:15.977538 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:15.977496    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 19:40:15.978037 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:15.977569    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 19:40:17.043821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:17.043732    2558 generic.go:356] "Generic (PLEG): container finished" podID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerID="dd024cc58c1b67a76a631d09a86e41d5a8950d31b005926d3395cac28f0bee1f" exitCode=0
Sep 10 19:40:17.043821 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:17.043808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" event={"ID":"95affc8c-27b4-41fb-9a10-eee9cf3eb406","Type":"ContainerDied","Data":"dd024cc58c1b67a76a631d09a86e41d5a8950d31b005926d3395cac28f0bee1f"}
Sep 10 19:40:17.044399 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:17.044314    2558 scope.go:117] "RemoveContainer" containerID="dd024cc58c1b67a76a631d09a86e41d5a8950d31b005926d3395cac28f0bee1f"
Sep 10 19:40:17.045492 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:17.045464    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:40:17.045656 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:17.045531    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:40:17.045656 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:17.045564    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:40:18.053719 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:18.053681    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" event={"ID":"95affc8c-27b4-41fb-9a10-eee9cf3eb406","Type":"ContainerStarted","Data":"5839185ddb41a0946d5238d03ba1b64ce557b71b8655e65ccf2f8739431ac368"}
Sep 10 19:40:18.587188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:18.587149    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:40:18.587451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:18.587426    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 19:40:18.587510 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:18.587481    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 19:40:19.587528 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:19.587491    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 19:40:19.587908 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:19.587544    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 19:40:20.587460 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:20.587423    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 19:40:20.587625 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:20.587493    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 19:40:21.587713 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:21.587671    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 19:40:21.588197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:21.587738    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 19:40:22.587554 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:22.587514    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 19:40:22.587734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:22.587573    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 19:40:23.587727 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:23.587691    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 19:40:23.588240 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:23.587747    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 19:40:24.591254 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:24.591222    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:40:24.591747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:24.591659    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:40:24.592432 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:24.592413    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:40:30.309204 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.309168    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"]
Sep 10 19:40:30.312247 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.312224    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.314834 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.314811    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-ff3019-serving-cert\""
Sep 10 19:40:30.326217 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.326193    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"]
Sep 10 19:40:30.346826 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.346787    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.347009 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.346879    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.347009 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.346908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj27l\" (UniqueName: \"kubernetes.io/projected/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-kube-api-access-zj27l\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.347138 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.347019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.448056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.448013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.448242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.448099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.448242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.448128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj27l\" (UniqueName: \"kubernetes.io/projected/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-kube-api-access-zj27l\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.448242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.448223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.448441 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:40:30.448261    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-serving-cert: secret "maas-api-e2e-shared-b-w2-ff3019-serving-cert" not found
Sep 10 19:40:30.448441 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:40:30.448335    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls podName:0d882fcb-e2f6-498f-ad6f-5dae6f86302e nodeName:}" failed. No retries permitted until 2026-09-10 19:40:30.948312536 +0000 UTC m=+1219.764922096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls") pod "maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" (UID: "0d882fcb-e2f6-498f-ad6f-5dae6f86302e") : secret "maas-api-e2e-shared-b-w2-ff3019-serving-cert" not found
Sep 10 19:40:30.448732 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.448711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.450775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.450751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.460694 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.460668    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj27l\" (UniqueName: \"kubernetes.io/projected/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-kube-api-access-zj27l\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.953205 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:30.953161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:30.953402 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:40:30.953344    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-serving-cert: secret "maas-api-e2e-shared-b-w2-ff3019-serving-cert" not found
Sep 10 19:40:30.953464 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:40:30.953455    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls podName:0d882fcb-e2f6-498f-ad6f-5dae6f86302e nodeName:}" failed. No retries permitted until 2026-09-10 19:40:31.953433578 +0000 UTC m=+1220.770043147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls") pod "maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" (UID: "0d882fcb-e2f6-498f-ad6f-5dae6f86302e") : secret "maas-api-e2e-shared-b-w2-ff3019-serving-cert" not found
Sep 10 19:40:31.964747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:31.964703    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:31.967079 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:31.967058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:32.127264 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:32.127228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:32.401206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:32.401176    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"]
Sep 10 19:40:32.402732 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:40:32.402706    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d882fcb_e2f6_498f_ad6f_5dae6f86302e.slice/crio-ae92fa959b1f7367d9c754920fe952345314fd3f3110f380fd8af14fa74683f1 WatchSource:0}: Error finding container ae92fa959b1f7367d9c754920fe952345314fd3f3110f380fd8af14fa74683f1: Status 404 returned error can't find the container with id ae92fa959b1f7367d9c754920fe952345314fd3f3110f380fd8af14fa74683f1
Sep 10 19:40:33.151241 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:33.151141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" event={"ID":"0d882fcb-e2f6-498f-ad6f-5dae6f86302e","Type":"ContainerStarted","Data":"86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0"}
Sep 10 19:40:33.151241 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:33.151195    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" event={"ID":"0d882fcb-e2f6-498f-ad6f-5dae6f86302e","Type":"ContainerStarted","Data":"ae92fa959b1f7367d9c754920fe952345314fd3f3110f380fd8af14fa74683f1"}
Sep 10 19:40:33.151699 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:33.151350    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:40:33.167674 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:33.167624    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" podStartSLOduration=2.683959498 podStartE2EDuration="3.167606619s" totalImagesPullingTime="483.647121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:40:33.166980732 +0000 UTC m=+1221.983590319" watchObservedRunningTime="2026-09-10 19:40:33.167606619 +0000 UTC m=+1221.984216191"
Sep 10 19:40:39.164572 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:40:39.164535    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:41:08.253092 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.253003    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"]
Sep 10 19:41:08.257123 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.257102    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.261170 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.261148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b97a9c60-serving-cert\""
Sep 10 19:41:08.267712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.267690    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"]
Sep 10 19:41:08.317843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.317808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-openshift-service-ca\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.317843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.317846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-metrics-certs\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.318053 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.317869    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4pnf\" (UniqueName: \"kubernetes.io/projected/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-kube-api-access-s4pnf\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.318053 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.318001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.419306 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.419269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.419500 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.419394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-openshift-service-ca\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.419500 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.419424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-metrics-certs\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.419500 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:41:08.419452    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-serving-cert: secret "maas-api-e2e-mt-b97a9c60-serving-cert" not found
Sep 10 19:41:08.419500 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.419457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4pnf\" (UniqueName: \"kubernetes.io/projected/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-kube-api-access-s4pnf\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.419714 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:41:08.419530    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls podName:6661ae7f-a3c3-4078-b76c-668c58d8f9d5 nodeName:}" failed. No retries permitted until 2026-09-10 19:41:08.919507574 +0000 UTC m=+1257.736117122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls") pod "maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g" (UID: "6661ae7f-a3c3-4078-b76c-668c58d8f9d5") : secret "maas-api-e2e-mt-b97a9c60-serving-cert" not found
Sep 10 19:41:08.420097 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.420073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-openshift-service-ca\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.421882 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.421860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-metrics-certs\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.428054 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.428035    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4pnf\" (UniqueName: \"kubernetes.io/projected/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-kube-api-access-s4pnf\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.925638 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.925603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:08.928111 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:08.928073    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls\") pod \"maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:09.168830 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:09.168798    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:09.458395 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:09.458357    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"]
Sep 10 19:41:09.460258 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:41:09.460227    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6661ae7f_a3c3_4078_b76c_668c58d8f9d5.slice/crio-876a04ee7b03d83088dcb55c59a73080262780cbea552ecca78a545a7e7b4655 WatchSource:0}: Error finding container 876a04ee7b03d83088dcb55c59a73080262780cbea552ecca78a545a7e7b4655: Status 404 returned error can't find the container with id 876a04ee7b03d83088dcb55c59a73080262780cbea552ecca78a545a7e7b4655
Sep 10 19:41:10.368230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:10.368127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g" event={"ID":"6661ae7f-a3c3-4078-b76c-668c58d8f9d5","Type":"ContainerStarted","Data":"283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a"}
Sep 10 19:41:10.368230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:10.368226    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:10.368502 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:10.368248    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g" event={"ID":"6661ae7f-a3c3-4078-b76c-668c58d8f9d5","Type":"ContainerStarted","Data":"876a04ee7b03d83088dcb55c59a73080262780cbea552ecca78a545a7e7b4655"}
Sep 10 19:41:10.389344 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:10.389293    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g" podStartSLOduration=1.826924767 podStartE2EDuration="2.389275966s" totalImagesPullingTime="562.351199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:41:10.386686545 +0000 UTC m=+1259.203296138" watchObservedRunningTime="2026-09-10 19:41:10.389275966 +0000 UTC m=+1259.205885571"
Sep 10 19:41:16.380787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:16.380752    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:41:40.391334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.391295    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"]
Sep 10 19:41:40.395501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.395479    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.399132 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.399108    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b97a9c60\"/\"default-dockercfg-82vgt\""
Sep 10 19:41:40.399280 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.399109    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b97a9c60\"/\"e2e-lifecycle-model-b97a9c60-kserve-self-signed-certs\""
Sep 10 19:41:40.399280 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.399171    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b97a9c60\"/\"kube-root-ca.crt\""
Sep 10 19:41:40.399280 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.399222    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b97a9c60\"/\"openshift-service-ca.crt\""
Sep 10 19:41:40.405916 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.405894    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"]
Sep 10 19:41:40.440327 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.440285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tls-certs\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.440564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.440474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-dshm\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.440564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.440520    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tmp-dir\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.440564 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.440556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-home\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.440713 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.440576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-model-cache\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.440713 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.440646    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4sbz\" (UniqueName: \"kubernetes.io/projected/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-kube-api-access-g4sbz\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.541712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.541675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-dshm\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.541712 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.541711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tmp-dir\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.541964 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.541735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-home\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.541964 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.541752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-model-cache\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.541964 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.541773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4sbz\" (UniqueName: \"kubernetes.io/projected/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-kube-api-access-g4sbz\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.541964 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.541808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tls-certs\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.542228 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.542207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-model-cache\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.542289 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.542230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-home\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.542327 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.542283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tmp-dir\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.544074 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.544052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-dshm\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.544220 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.544203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tls-certs\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.550194 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.550171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4sbz\" (UniqueName: \"kubernetes.io/projected/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-kube-api-access-g4sbz\") pod \"e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") " pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.706260 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.706227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:40.980603 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:40.980561    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"]
Sep 10 19:41:40.982428 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:41:40.982360    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26baeebd_bb6a_49b2_96e5_f52ec63f5cbf.slice/crio-020f36ed1c58a980da31350c5237935bc07d60f08824e3185ce245b07c7fc200 WatchSource:0}: Error finding container 020f36ed1c58a980da31350c5237935bc07d60f08824e3185ce245b07c7fc200: Status 404 returned error can't find the container with id 020f36ed1c58a980da31350c5237935bc07d60f08824e3185ce245b07c7fc200
Sep 10 19:41:41.558868 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:41.558828    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd" event={"ID":"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf","Type":"ContainerStarted","Data":"6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93"}
Sep 10 19:41:41.559238 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:41.558873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd" event={"ID":"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf","Type":"ContainerStarted","Data":"020f36ed1c58a980da31350c5237935bc07d60f08824e3185ce245b07c7fc200"}
Sep 10 19:41:41.577255 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:41.577200    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd" podStartSLOduration=1.5771834839999999 podStartE2EDuration="1.577183484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:41:41.574725835 +0000 UTC m=+1290.391335422" watchObservedRunningTime="2026-09-10 19:41:41.577183484 +0000 UTC m=+1290.393793097"
Sep 10 19:41:50.706996 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:50.706956    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:50.707531 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:50.707031    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:50.719543 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:50.719516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:41:51.628367 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:41:51.628328    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:42:37.189197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.189117    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"]
Sep 10 19:42:37.189744 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.189412    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g" podUID="6661ae7f-a3c3-4078-b76c-668c58d8f9d5" containerName="maas-api" containerID="cri-o://283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a" gracePeriod=30
Sep 10 19:42:37.456110 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.456054    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:42:37.608359 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.608320    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-openshift-service-ca\") pod \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") "
Sep 10 19:42:37.608591 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.608424    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls\") pod \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") "
Sep 10 19:42:37.608591 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.608565    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-metrics-certs\") pod \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") "
Sep 10 19:42:37.609253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.608827    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4pnf\" (UniqueName: \"kubernetes.io/projected/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-kube-api-access-s4pnf\") pod \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\" (UID: \"6661ae7f-a3c3-4078-b76c-668c58d8f9d5\") "
Sep 10 19:42:37.609395 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.609294    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6661ae7f-a3c3-4078-b76c-668c58d8f9d5" (UID: "6661ae7f-a3c3-4078-b76c-668c58d8f9d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:42:37.610944 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.610916    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6661ae7f-a3c3-4078-b76c-668c58d8f9d5" (UID: "6661ae7f-a3c3-4078-b76c-668c58d8f9d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:42:37.611321 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.611305    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6661ae7f-a3c3-4078-b76c-668c58d8f9d5" (UID: "6661ae7f-a3c3-4078-b76c-668c58d8f9d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:42:37.611568 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.611540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-kube-api-access-s4pnf" (OuterVolumeSpecName: "kube-api-access-s4pnf") pod "6661ae7f-a3c3-4078-b76c-668c58d8f9d5" (UID: "6661ae7f-a3c3-4078-b76c-668c58d8f9d5"). InnerVolumeSpecName "kube-api-access-s4pnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:42:37.710456 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.710355    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:42:37.710456 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.710407    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4pnf\" (UniqueName: \"kubernetes.io/projected/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-kube-api-access-s4pnf\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:42:37.710456 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.710420    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:42:37.710456 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.710429    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6661ae7f-a3c3-4078-b76c-668c58d8f9d5-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:42:37.895694 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.895660    2558 generic.go:356] "Generic (PLEG): container finished" podID="6661ae7f-a3c3-4078-b76c-668c58d8f9d5" containerID="283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a" exitCode=0
Sep 10 19:42:37.895866 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.895702    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"
Sep 10 19:42:37.895866 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.895709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g" event={"ID":"6661ae7f-a3c3-4078-b76c-668c58d8f9d5","Type":"ContainerDied","Data":"283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a"}
Sep 10 19:42:37.895866 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.895749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g" event={"ID":"6661ae7f-a3c3-4078-b76c-668c58d8f9d5","Type":"ContainerDied","Data":"876a04ee7b03d83088dcb55c59a73080262780cbea552ecca78a545a7e7b4655"}
Sep 10 19:42:37.895866 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.895771    2558 scope.go:117] "RemoveContainer" containerID="283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a"
Sep 10 19:42:37.905271 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.905255    2558 scope.go:117] "RemoveContainer" containerID="283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a"
Sep 10 19:42:37.905549 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:42:37.905530    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a\": container with ID starting with 283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a not found: ID does not exist" containerID="283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a"
Sep 10 19:42:37.905627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.905557    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a"} err="failed to get container status \"283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a\": rpc error: code = NotFound desc = could not find container \"283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a\": container with ID starting with 283135dc93143ce9944f6339feaf04cb6dc2c8e9f43be8f53a213dddd2e9712a not found: ID does not exist"
Sep 10 19:42:37.912684 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.912665    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"]
Sep 10 19:42:37.916687 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:37.916667    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b97a9c60-6fb47d77bd-w7w5g"]
Sep 10 19:42:39.656840 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:39.656804    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6661ae7f-a3c3-4078-b76c-668c58d8f9d5" path="/var/lib/kubelet/pods/6661ae7f-a3c3-4078-b76c-668c58d8f9d5/volumes"
Sep 10 19:42:45.645888 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:42:45.645854    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"]
Sep 10 19:43:00.666818 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:00.666775    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd" podUID="26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" containerName="main" containerID="cri-o://6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93" gracePeriod=45
Sep 10 19:43:00.927767 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:00.927709    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:43:01.033847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.033811    2558 generic.go:356] "Generic (PLEG): container finished" podID="26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" containerID="6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93" exitCode=0
Sep 10 19:43:01.034002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.033859    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"
Sep 10 19:43:01.034002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.033894    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd" event={"ID":"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf","Type":"ContainerDied","Data":"6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93"}
Sep 10 19:43:01.034002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.033939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd" event={"ID":"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf","Type":"ContainerDied","Data":"020f36ed1c58a980da31350c5237935bc07d60f08824e3185ce245b07c7fc200"}
Sep 10 19:43:01.034002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.033958    2558 scope.go:117] "RemoveContainer" containerID="6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93"
Sep 10 19:43:01.043969 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.043951    2558 scope.go:117] "RemoveContainer" containerID="6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93"
Sep 10 19:43:01.044273 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:43:01.044253    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93\": container with ID starting with 6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93 not found: ID does not exist" containerID="6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93"
Sep 10 19:43:01.044343 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.044285    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93"} err="failed to get container status \"6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93\": rpc error: code = NotFound desc = could not find container \"6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93\": container with ID starting with 6e6779c118c31850ee088661d91334acbfecb9e619e50dfd62de35ffbba6bc93 not found: ID does not exist"
Sep 10 19:43:01.047655 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.047635    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-home\") pod \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") "
Sep 10 19:43:01.047731 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.047686    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tls-certs\") pod \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") "
Sep 10 19:43:01.047771 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.047752    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-model-cache\") pod \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") "
Sep 10 19:43:01.047822 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.047781    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4sbz\" (UniqueName: \"kubernetes.io/projected/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-kube-api-access-g4sbz\") pod \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") "
Sep 10 19:43:01.047894 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.047875    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tmp-dir\") pod \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") "
Sep 10 19:43:01.047953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.047906    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-home" (OuterVolumeSpecName: "home") pod "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" (UID: "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:43:01.047953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.047913    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-dshm\") pod \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\" (UID: \"26baeebd-bb6a-49b2-96e5-f52ec63f5cbf\") "
Sep 10 19:43:01.048060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.048035    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-model-cache" (OuterVolumeSpecName: "model-cache") pod "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" (UID: "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:43:01.048296 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.048262    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" (UID: "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:43:01.048427 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.048326    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-home\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:43:01.048427 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.048343    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-model-cache\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:43:01.050431 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.050400    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-dshm" (OuterVolumeSpecName: "dshm") pod "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" (UID: "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:43:01.050526 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.050467    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" (UID: "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:43:01.050526 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.050487    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-kube-api-access-g4sbz" (OuterVolumeSpecName: "kube-api-access-g4sbz") pod "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" (UID: "26baeebd-bb6a-49b2-96e5-f52ec63f5cbf"). InnerVolumeSpecName "kube-api-access-g4sbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:43:01.148918 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.148880    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-dshm\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:43:01.148918 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.148911    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tls-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:43:01.148918 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.148922    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4sbz\" (UniqueName: \"kubernetes.io/projected/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-kube-api-access-g4sbz\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:43:01.148918 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.148930    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf-tmp-dir\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:43:01.356395 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.356350    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"]
Sep 10 19:43:01.362426 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.362399    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b97a9c60/e2e-lifecycle-model-b97a9c60-kserve-687799f9f-msjcd"]
Sep 10 19:43:01.656269 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:43:01.656190    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" path="/var/lib/kubelet/pods/26baeebd-bb6a-49b2-96e5-f52ec63f5cbf/volumes"
Sep 10 19:44:52.882426 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.882386    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"]
Sep 10 19:44:52.882883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.882817    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6661ae7f-a3c3-4078-b76c-668c58d8f9d5" containerName="maas-api"
Sep 10 19:44:52.882883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.882829    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6661ae7f-a3c3-4078-b76c-668c58d8f9d5" containerName="maas-api"
Sep 10 19:44:52.882883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.882849    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" containerName="main"
Sep 10 19:44:52.882883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.882855    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" containerName="main"
Sep 10 19:44:52.883018 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.882922    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6661ae7f-a3c3-4078-b76c-668c58d8f9d5" containerName="maas-api"
Sep 10 19:44:52.883018 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.882932    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="26baeebd-bb6a-49b2-96e5-f52ec63f5cbf" containerName="main"
Sep 10 19:44:52.886227 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.886210    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.888938 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.888899    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d77d5a-openshift-default-dockercfg-s9wtm\""
Sep 10 19:44:52.908182 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.908154    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"]
Sep 10 19:44:52.932277 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932252    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-credential-socket\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932299    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-envoy\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932328    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-data\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-podinfo\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-socket\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b1a842-277a-4e2e-97da-73e4b00d951e-istiod-ca-cert\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-token\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932567    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxrs\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-kube-api-access-vjxrs\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:52.932604 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:52.932597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-certs\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033114 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-envoy\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-data\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-podinfo\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-socket\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033214    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b1a842-277a-4e2e-97da-73e4b00d951e-istiod-ca-cert\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-token\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxrs\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-kube-api-access-vjxrs\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-certs\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-credential-socket\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033767 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-socket\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033826 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033760    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-credential-socket\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.033826 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033817    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-certs\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.034006 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.033981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-data\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.034111 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.034048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b1a842-277a-4e2e-97da-73e4b00d951e-istiod-ca-cert\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.035552 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.035531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-envoy\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.035731 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.035709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-podinfo\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.042000 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.041975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-token\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.042189 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.042167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxrs\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-kube-api-access-vjxrs\") pod \"e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") " pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.197494 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.197459    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:53.482391 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.482342    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"]
Sep 10 19:44:53.483904 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:44:53.483877    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b1a842_277a_4e2e_97da_73e4b00d951e.slice/crio-dd2c0a1ab958e19d9f58a1ed90d2fe024069a314d350bbe17ce131191fe87bae WatchSource:0}: Error finding container dd2c0a1ab958e19d9f58a1ed90d2fe024069a314d350bbe17ce131191fe87bae: Status 404 returned error can't find the container with id dd2c0a1ab958e19d9f58a1ed90d2fe024069a314d350bbe17ce131191fe87bae
Sep 10 19:44:53.486328 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.486297    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:44:53.486411 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.486365    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:44:53.486455 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.486411    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:44:53.691177 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.691143    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" event={"ID":"e2b1a842-277a-4e2e-97da-73e4b00d951e","Type":"ContainerStarted","Data":"bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f"}
Sep 10 19:44:53.691401 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.691197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" event={"ID":"e2b1a842-277a-4e2e-97da-73e4b00d951e","Type":"ContainerStarted","Data":"dd2c0a1ab958e19d9f58a1ed90d2fe024069a314d350bbe17ce131191fe87bae"}
Sep 10 19:44:53.712480 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:53.712423    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podStartSLOduration=1.712405151 podStartE2EDuration="1.712405151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:44:53.71047044 +0000 UTC m=+1482.527080032" watchObservedRunningTime="2026-09-10 19:44:53.712405151 +0000 UTC m=+1482.529014721"
Sep 10 19:44:54.198614 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:54.198519    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:54.200105 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:54.200074    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 19:44:54.200215 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:54.200134    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 19:44:55.203121 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:55.203089    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:55.703157 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:55.703119    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:55.704087 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:55.704067    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:44:57.018491 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.018452    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"]
Sep 10 19:44:57.023843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.023820    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.026294 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.026255    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d77d5a-serving-cert\""
Sep 10 19:44:57.030501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.030475    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"]
Sep 10 19:44:57.073999 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.073961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-openshift-service-ca\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.074172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.074008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-maas-api-tls\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.074172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.074028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-metrics-certs\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.074172 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.074081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvx4b\" (UniqueName: \"kubernetes.io/projected/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-kube-api-access-pvx4b\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.175043 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.175002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-openshift-service-ca\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.175236 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.175053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-maas-api-tls\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.175236 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.175084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-metrics-certs\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.175236 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.175125    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvx4b\" (UniqueName: \"kubernetes.io/projected/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-kube-api-access-pvx4b\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.175804 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.175770    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-openshift-service-ca\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.177668 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.177643    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-metrics-certs\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.177769 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.177670    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-maas-api-tls\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.184888 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.184862    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvx4b\" (UniqueName: \"kubernetes.io/projected/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-kube-api-access-pvx4b\") pod \"maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.337563 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.337471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:57.615914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.615883    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"]
Sep 10 19:44:57.617322 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:44:57.617294    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda1f689_8c4c_48f1_9b5d_3608a9bf93fe.slice/crio-73a64cff00d74f6a86de8371033c57f6774e6abe9e52d292b2b9a0bb44a2f33e WatchSource:0}: Error finding container 73a64cff00d74f6a86de8371033c57f6774e6abe9e52d292b2b9a0bb44a2f33e: Status 404 returned error can't find the container with id 73a64cff00d74f6a86de8371033c57f6774e6abe9e52d292b2b9a0bb44a2f33e
Sep 10 19:44:57.618806 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.618788    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:44:57.717005 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:57.716968    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6" event={"ID":"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe","Type":"ContainerStarted","Data":"73a64cff00d74f6a86de8371033c57f6774e6abe9e52d292b2b9a0bb44a2f33e"}
Sep 10 19:44:58.725702 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:58.725669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6" event={"ID":"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe","Type":"ContainerStarted","Data":"1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171"}
Sep 10 19:44:58.726160 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:58.725858    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:44:58.754985 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:44:58.754934    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6" podStartSLOduration=2.27204335 podStartE2EDuration="2.754916214s" totalImagesPullingTime="482.872864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:44:58.75388275 +0000 UTC m=+1487.570492363" watchObservedRunningTime="2026-09-10 19:44:58.754916214 +0000 UTC m=+1487.571525781"
Sep 10 19:45:04.736987 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:04.736954    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:45:11.505574 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.505347    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": read tcp 10.133.0.2:42944->10.133.0.71:15021: read: connection reset by peer" start-of-body=
Sep 10 19:45:11.505953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.505574    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": read tcp 10.133.0.2:42944->10.133.0.71:15021: read: connection reset by peer"
Sep 10 19:45:11.817653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.817563    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerID="bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f" exitCode=0
Sep 10 19:45:11.817653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.817621    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" event={"ID":"e2b1a842-277a-4e2e-97da-73e4b00d951e","Type":"ContainerDied","Data":"bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f"}
Sep 10 19:45:11.818053 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.818040    2558 scope.go:117] "RemoveContainer" containerID="bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f"
Sep 10 19:45:11.819206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.819175    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:45:11.819311 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.819261    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:45:11.819393 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:11.819309    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:45:12.826525 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:12.826491    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" event={"ID":"e2b1a842-277a-4e2e-97da-73e4b00d951e","Type":"ContainerStarted","Data":"de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba"}
Sep 10 19:45:13.197832 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:13.197801    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:45:13.198019 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:13.198000    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 19:45:13.198081 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:13.198043    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 19:45:14.198599 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:14.198559    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 19:45:14.199006 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:14.198633    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 19:45:15.198169 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:15.198132    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 19:45:15.198361 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:15.198188    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 19:45:16.197799 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:16.197758    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 19:45:16.198312 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:16.197826    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 19:45:17.198852 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:17.198812    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 19:45:17.199335 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:17.198879    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 19:45:18.198606 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:18.198573    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 19:45:18.198785 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:18.198636    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 19:45:19.201482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:19.201438    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:45:19.201887 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:19.201837    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:45:19.202457 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:19.202436    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:45:26.014029 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.013994    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"]
Sep 10 19:45:26.017168 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.017145    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.019611 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.019588    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-261db5-serving-cert\""
Sep 10 19:45:26.030355 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.030327    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"]
Sep 10 19:45:26.183129 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.183090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-metrics-certs\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.183302 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.183145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v5q2\" (UniqueName: \"kubernetes.io/projected/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-kube-api-access-4v5q2\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.183302 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.183169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.183302 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.183209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-openshift-service-ca\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.284199 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.284109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-metrics-certs\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.284199 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.284164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v5q2\" (UniqueName: \"kubernetes.io/projected/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-kube-api-access-4v5q2\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.284199 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.284190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.284555 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.284215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-openshift-service-ca\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.284555 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:45:26.284335    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-serving-cert: secret "maas-api-e2e-api-b-261db5-serving-cert" not found
Sep 10 19:45:26.284555 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:45:26.284419    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls podName:b993a235-e4aa-4c3d-9db0-5cd2b4aae865 nodeName:}" failed. No retries permitted until 2026-09-10 19:45:26.784402418 +0000 UTC m=+1515.601011963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls") pod "maas-api-e2e-api-b-261db5-766b956dbf-dtxk4" (UID: "b993a235-e4aa-4c3d-9db0-5cd2b4aae865") : secret "maas-api-e2e-api-b-261db5-serving-cert" not found
Sep 10 19:45:26.284919 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.284900    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-openshift-service-ca\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.286546 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.286525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-metrics-certs\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.293038 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.293014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v5q2\" (UniqueName: \"kubernetes.io/projected/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-kube-api-access-4v5q2\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.789599 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.789563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.791983 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.791956    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls\") pod \"maas-api-e2e-api-b-261db5-766b956dbf-dtxk4\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:26.928938 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:26.928900    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:27.212743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:27.212714    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"]
Sep 10 19:45:27.214025 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:45:27.213994    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb993a235_e4aa_4c3d_9db0_5cd2b4aae865.slice/crio-a01b4b6552862b96f2b815d03fd0f174e2b50f28edec9d0dce371c97c32b3af9 WatchSource:0}: Error finding container a01b4b6552862b96f2b815d03fd0f174e2b50f28edec9d0dce371c97c32b3af9: Status 404 returned error can't find the container with id a01b4b6552862b96f2b815d03fd0f174e2b50f28edec9d0dce371c97c32b3af9
Sep 10 19:45:27.927343 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:27.927241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4" event={"ID":"b993a235-e4aa-4c3d-9db0-5cd2b4aae865","Type":"ContainerStarted","Data":"9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1"}
Sep 10 19:45:27.927343 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:27.927341    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4" event={"ID":"b993a235-e4aa-4c3d-9db0-5cd2b4aae865","Type":"ContainerStarted","Data":"a01b4b6552862b96f2b815d03fd0f174e2b50f28edec9d0dce371c97c32b3af9"}
Sep 10 19:45:27.927560 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:27.927364    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:45:27.949995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:27.949925    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4" podStartSLOduration=2.516389067 podStartE2EDuration="2.949907298s" totalImagesPullingTime="433.518231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:45:27.945166968 +0000 UTC m=+1516.761776556" watchObservedRunningTime="2026-09-10 19:45:27.949907298 +0000 UTC m=+1516.766516906"
Sep 10 19:45:33.939216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:45:33.939141    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:46:09.404327 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.404290    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"]
Sep 10 19:46:09.404912 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.404595    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6" podUID="fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" containerName="maas-api" containerID="cri-o://1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171" gracePeriod=30
Sep 10 19:46:09.669333 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.669274    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:46:09.800340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.800308    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-openshift-service-ca\") pod \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") "
Sep 10 19:46:09.800551 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.800393    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-maas-api-tls\") pod \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") "
Sep 10 19:46:09.800551 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.800527    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvx4b\" (UniqueName: \"kubernetes.io/projected/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-kube-api-access-pvx4b\") pod \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") "
Sep 10 19:46:09.800687 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.800632    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-metrics-certs\") pod \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\" (UID: \"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe\") "
Sep 10 19:46:09.801056 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.801022    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" (UID: "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:09.801186 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.801172    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:09.812361 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.804899    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" (UID: "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:09.812361 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.804912    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" (UID: "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:09.812361 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.812299    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-kube-api-access-pvx4b" (OuterVolumeSpecName: "kube-api-access-pvx4b") pod "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" (UID: "fda1f689-8c4c-48f1-9b5d-3608a9bf93fe"). InnerVolumeSpecName "kube-api-access-pvx4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:09.901957 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.901925    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:09.901957 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.901955    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvx4b\" (UniqueName: \"kubernetes.io/projected/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-kube-api-access-pvx4b\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:09.901957 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:09.901965    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:10.190421 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.190359    2558 generic.go:356] "Generic (PLEG): container finished" podID="fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" containerID="1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171" exitCode=0
Sep 10 19:46:10.190597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.190442    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"
Sep 10 19:46:10.190597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.190440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6" event={"ID":"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe","Type":"ContainerDied","Data":"1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171"}
Sep 10 19:46:10.190597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.190498    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6" event={"ID":"fda1f689-8c4c-48f1-9b5d-3608a9bf93fe","Type":"ContainerDied","Data":"73a64cff00d74f6a86de8371033c57f6774e6abe9e52d292b2b9a0bb44a2f33e"}
Sep 10 19:46:10.190597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.190523    2558 scope.go:117] "RemoveContainer" containerID="1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171"
Sep 10 19:46:10.208069 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.208047    2558 scope.go:117] "RemoveContainer" containerID="1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171"
Sep 10 19:46:10.208410 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:10.208369    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171\": container with ID starting with 1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171 not found: ID does not exist" containerID="1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171"
Sep 10 19:46:10.208478 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.208419    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171"} err="failed to get container status \"1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171\": rpc error: code = NotFound desc = could not find container \"1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171\": container with ID starting with 1796fbe0d32c8420124e24f56f01171b60b707cc1e5966f56ecae6ca23065171 not found: ID does not exist"
Sep 10 19:46:10.217419 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.217395    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"]
Sep 10 19:46:10.221200 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:10.221177    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d77d5a-556dcf97d4-74qw6"]
Sep 10 19:46:11.657324 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:11.657290    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" path="/var/lib/kubelet/pods/fda1f689-8c4c-48f1-9b5d-3608a9bf93fe/volumes"
Sep 10 19:46:16.206155 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:16.206111    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"]
Sep 10 19:46:16.206704 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:16.206427    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" containerID="cri-o://de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba" gracePeriod=30
Sep 10 19:46:19.204899 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:19.204863    2558 patch_prober.go:28] interesting pod/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 19:46:19.205276 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:19.204948    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 19:46:21.476282 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.476216    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:46:21.510463 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510435    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b1a842-277a-4e2e-97da-73e4b00d951e-istiod-ca-cert\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510507    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-data\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjxrs\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-kube-api-access-vjxrs\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510600    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-token\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510629    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-socket\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510656    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-envoy\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510685    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-podinfo\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510796 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510743    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-credential-socket\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510988 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510794    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-certs\") pod \"e2b1a842-277a-4e2e-97da-73e4b00d951e\" (UID: \"e2b1a842-277a-4e2e-97da-73e4b00d951e\") "
Sep 10 19:46:21.510988 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510828    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:46:21.510988 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.510969    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b1a842-277a-4e2e-97da-73e4b00d951e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:21.511147 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.511060    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:46:21.511206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.511187    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b1a842-277a-4e2e-97da-73e4b00d951e-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.511264 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.511193    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:46:21.511264 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.511204    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.511264 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.511247    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.511479 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.511457    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:46:21.512872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.512840    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:46:21.513242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.513218    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:46:21.513345 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.513276    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:21.513430 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.513365    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-kube-api-access-vjxrs" (OuterVolumeSpecName: "kube-api-access-vjxrs") pod "e2b1a842-277a-4e2e-97da-73e4b00d951e" (UID: "e2b1a842-277a-4e2e-97da-73e4b00d951e"). InnerVolumeSpecName "kube-api-access-vjxrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:21.612263 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.612229    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjxrs\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-kube-api-access-vjxrs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.612263 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.612257    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.612263 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.612266    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.612263 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.612274    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.612557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.612284    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b1a842-277a-4e2e-97da-73e4b00d951e-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:21.612557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:21.612291    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b1a842-277a-4e2e-97da-73e4b00d951e-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:22.276252 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.276220    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerID="de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba" exitCode=0
Sep 10 19:46:22.276464 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.276271    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"
Sep 10 19:46:22.276464 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.276303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" event={"ID":"e2b1a842-277a-4e2e-97da-73e4b00d951e","Type":"ContainerDied","Data":"de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba"}
Sep 10 19:46:22.276464 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.276359    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf" event={"ID":"e2b1a842-277a-4e2e-97da-73e4b00d951e","Type":"ContainerDied","Data":"dd2c0a1ab958e19d9f58a1ed90d2fe024069a314d350bbe17ce131191fe87bae"}
Sep 10 19:46:22.276464 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.276402    2558 scope.go:117] "RemoveContainer" containerID="de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba"
Sep 10 19:46:22.285573 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.285554    2558 scope.go:117] "RemoveContainer" containerID="bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f"
Sep 10 19:46:22.293922 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.293904    2558 scope.go:117] "RemoveContainer" containerID="de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba"
Sep 10 19:46:22.294178 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:22.294157    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba\": container with ID starting with de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba not found: ID does not exist" containerID="de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba"
Sep 10 19:46:22.294220 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.294187    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba"} err="failed to get container status \"de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba\": rpc error: code = NotFound desc = could not find container \"de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba\": container with ID starting with de555da1c4104bf01c81ae4e857026835c1034bf9226ff3928e29dbee7ba02ba not found: ID does not exist"
Sep 10 19:46:22.294220 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.294204    2558 scope.go:117] "RemoveContainer" containerID="bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f"
Sep 10 19:46:22.294462 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:22.294445    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f\": container with ID starting with bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f not found: ID does not exist" containerID="bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f"
Sep 10 19:46:22.294514 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.294468    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f"} err="failed to get container status \"bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f\": rpc error: code = NotFound desc = could not find container \"bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f\": container with ID starting with bd79a59fa8c59a8f9241874e4cf2d76dc7ed2cb7e157c9443bc0a88188549a4f not found: ID does not exist"
Sep 10 19:46:22.306923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.306900    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"]
Sep 10 19:46:22.309477 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:22.309458    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d77d5a-openshift-default-6d755d9f6-6xzmf"]
Sep 10 19:46:23.657304 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:23.657272    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" path="/var/lib/kubelet/pods/e2b1a842-277a-4e2e-97da-73e4b00d951e/volumes"
Sep 10 19:46:26.023418 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023367    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"]
Sep 10 19:46:26.023890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023847    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" containerName="maas-api"
Sep 10 19:46:26.023890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023861    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" containerName="maas-api"
Sep 10 19:46:26.023890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023890    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy"
Sep 10 19:46:26.024077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023896    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy"
Sep 10 19:46:26.024077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023903    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy"
Sep 10 19:46:26.024077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023910    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy"
Sep 10 19:46:26.024077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023974    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy"
Sep 10 19:46:26.024077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023982    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b1a842-277a-4e2e-97da-73e4b00d951e" containerName="istio-proxy"
Sep 10 19:46:26.024077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.023989    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda1f689-8c4c-48f1-9b5d-3608a9bf93fe" containerName="maas-api"
Sep 10 19:46:26.027095 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.027072    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.029577 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.029552    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-836291-serving-cert\""
Sep 10 19:46:26.041527 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.041497    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"]
Sep 10 19:46:26.054955 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.054915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78c2ea8-581c-4dec-8cfe-792deda0b38e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.055114 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.054961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzf6b\" (UniqueName: \"kubernetes.io/projected/e78c2ea8-581c-4dec-8cfe-792deda0b38e-kube-api-access-wzf6b\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.055114 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.055036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-metrics-certs\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.055230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.055145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.155962 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.155925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.156165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.155992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78c2ea8-581c-4dec-8cfe-792deda0b38e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.156165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.156020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzf6b\" (UniqueName: \"kubernetes.io/projected/e78c2ea8-581c-4dec-8cfe-792deda0b38e-kube-api-access-wzf6b\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.156165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.156055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-metrics-certs\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.156165 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:26.156081    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-serving-cert: secret "maas-api-e2e-ipp-a-836291-serving-cert" not found
Sep 10 19:46:26.156165 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:26.156153    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls podName:e78c2ea8-581c-4dec-8cfe-792deda0b38e nodeName:}" failed. No retries permitted until 2026-09-10 19:46:26.656136347 +0000 UTC m=+1575.472745897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls") pod "maas-api-e2e-ipp-a-836291-7687db598b-4gh2x" (UID: "e78c2ea8-581c-4dec-8cfe-792deda0b38e") : secret "maas-api-e2e-ipp-a-836291-serving-cert" not found
Sep 10 19:46:26.156822 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.156799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78c2ea8-581c-4dec-8cfe-792deda0b38e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.158553 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.158534    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-metrics-certs\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.166503 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.166472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzf6b\" (UniqueName: \"kubernetes.io/projected/e78c2ea8-581c-4dec-8cfe-792deda0b38e-kube-api-access-wzf6b\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.660786 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.660751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.663122 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.663098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-836291-7687db598b-4gh2x\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:26.938989 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:26.938958    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:27.214423 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:27.214396    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"]
Sep 10 19:46:27.215499 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:46:27.215472    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78c2ea8_581c_4dec_8cfe_792deda0b38e.slice/crio-ecec8cede153c35a1512f9de7b794dbc3e0f0d70f77072309dd588099e83c3a6 WatchSource:0}: Error finding container ecec8cede153c35a1512f9de7b794dbc3e0f0d70f77072309dd588099e83c3a6: Status 404 returned error can't find the container with id ecec8cede153c35a1512f9de7b794dbc3e0f0d70f77072309dd588099e83c3a6
Sep 10 19:46:27.309348 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:27.309312    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x" event={"ID":"e78c2ea8-581c-4dec-8cfe-792deda0b38e","Type":"ContainerStarted","Data":"ecec8cede153c35a1512f9de7b794dbc3e0f0d70f77072309dd588099e83c3a6"}
Sep 10 19:46:28.317631 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:28.317593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x" event={"ID":"e78c2ea8-581c-4dec-8cfe-792deda0b38e","Type":"ContainerStarted","Data":"1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830"}
Sep 10 19:46:28.318204 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:28.317655    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:28.338405 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:28.338343    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x" podStartSLOduration=1.738131361 podStartE2EDuration="2.338328555s" totalImagesPullingTime="600.197194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:46:28.335612887 +0000 UTC m=+1577.152222491" watchObservedRunningTime="2026-09-10 19:46:28.338328555 +0000 UTC m=+1577.154938122"
Sep 10 19:46:31.867724 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:31.867688    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"]
Sep 10 19:46:31.868179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:31.867949    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4" podUID="b993a235-e4aa-4c3d-9db0-5cd2b4aae865" containerName="maas-api" containerID="cri-o://9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1" gracePeriod=30
Sep 10 19:46:32.118080 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.118021    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:46:32.216913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.216885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls\") pod \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") "
Sep 10 19:46:32.217052 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.216931    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v5q2\" (UniqueName: \"kubernetes.io/projected/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-kube-api-access-4v5q2\") pod \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") "
Sep 10 19:46:32.217052 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.216966    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-openshift-service-ca\") pod \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") "
Sep 10 19:46:32.217176 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.217085    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-metrics-certs\") pod \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\" (UID: \"b993a235-e4aa-4c3d-9db0-5cd2b4aae865\") "
Sep 10 19:46:32.217441 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.217408    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b993a235-e4aa-4c3d-9db0-5cd2b4aae865" (UID: "b993a235-e4aa-4c3d-9db0-5cd2b4aae865"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:32.219082 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.219059    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b993a235-e4aa-4c3d-9db0-5cd2b4aae865" (UID: "b993a235-e4aa-4c3d-9db0-5cd2b4aae865"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:32.219179 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.219123    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-kube-api-access-4v5q2" (OuterVolumeSpecName: "kube-api-access-4v5q2") pod "b993a235-e4aa-4c3d-9db0-5cd2b4aae865" (UID: "b993a235-e4aa-4c3d-9db0-5cd2b4aae865"). InnerVolumeSpecName "kube-api-access-4v5q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:32.219489 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.219467    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b993a235-e4aa-4c3d-9db0-5cd2b4aae865" (UID: "b993a235-e4aa-4c3d-9db0-5cd2b4aae865"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:32.318206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.318171    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:32.318206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.318198    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:32.318206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.318208    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v5q2\" (UniqueName: \"kubernetes.io/projected/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-kube-api-access-4v5q2\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:32.318460 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.318217    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b993a235-e4aa-4c3d-9db0-5cd2b4aae865-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:32.342578 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.342546    2558 generic.go:356] "Generic (PLEG): container finished" podID="b993a235-e4aa-4c3d-9db0-5cd2b4aae865" containerID="9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1" exitCode=0
Sep 10 19:46:32.342743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.342611    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"
Sep 10 19:46:32.342743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.342635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4" event={"ID":"b993a235-e4aa-4c3d-9db0-5cd2b4aae865","Type":"ContainerDied","Data":"9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1"}
Sep 10 19:46:32.342743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.342694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4" event={"ID":"b993a235-e4aa-4c3d-9db0-5cd2b4aae865","Type":"ContainerDied","Data":"a01b4b6552862b96f2b815d03fd0f174e2b50f28edec9d0dce371c97c32b3af9"}
Sep 10 19:46:32.342743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.342721    2558 scope.go:117] "RemoveContainer" containerID="9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1"
Sep 10 19:46:32.352553 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.352532    2558 scope.go:117] "RemoveContainer" containerID="9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1"
Sep 10 19:46:32.352985 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:32.352853    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1\": container with ID starting with 9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1 not found: ID does not exist" containerID="9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1"
Sep 10 19:46:32.352985 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.352891    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1"} err="failed to get container status \"9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1\": rpc error: code = NotFound desc = could not find container \"9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1\": container with ID starting with 9862069d266a5d2d504b9741541c84a6f5dea1f7a56ceed5600c86cf178fe1b1 not found: ID does not exist"
Sep 10 19:46:32.371226 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.371166    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"]
Sep 10 19:46:32.375113 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:32.375092    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-261db5-766b956dbf-dtxk4"]
Sep 10 19:46:33.656923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:33.656881    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b993a235-e4aa-4c3d-9db0-5cd2b4aae865" path="/var/lib/kubelet/pods/b993a235-e4aa-4c3d-9db0-5cd2b4aae865/volumes"
Sep 10 19:46:34.329743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:34.329711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:46:49.191224 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.191190    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"]
Sep 10 19:46:49.191823 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.191460    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9" podUID="bb4cc443-e25f-48e3-8c13-e74b00defa5c" containerName="maas-api" containerID="cri-o://862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4" gracePeriod=30
Sep 10 19:46:49.438845 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.438820    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:46:49.443032 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.442964    2558 generic.go:356] "Generic (PLEG): container finished" podID="bb4cc443-e25f-48e3-8c13-e74b00defa5c" containerID="862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4" exitCode=0
Sep 10 19:46:49.443032 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.443003    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"
Sep 10 19:46:49.443397 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.443052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9" event={"ID":"bb4cc443-e25f-48e3-8c13-e74b00defa5c","Type":"ContainerDied","Data":"862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4"}
Sep 10 19:46:49.443397 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.443121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9" event={"ID":"bb4cc443-e25f-48e3-8c13-e74b00defa5c","Type":"ContainerDied","Data":"342843d74d14d732b3e77fd97c128d5fdd4c496e8dee2482780da5f3201d23e9"}
Sep 10 19:46:49.443397 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.443210    2558 scope.go:117] "RemoveContainer" containerID="862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4"
Sep 10 19:46:49.452486 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.452459    2558 scope.go:117] "RemoveContainer" containerID="862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4"
Sep 10 19:46:49.452784 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:49.452765    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4\": container with ID starting with 862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4 not found: ID does not exist" containerID="862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4"
Sep 10 19:46:49.452858 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.452793    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4"} err="failed to get container status \"862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4\": rpc error: code = NotFound desc = could not find container \"862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4\": container with ID starting with 862f764e265ac611c6fdf986ebca3e608a423c6beec5117437023d1fb7adb1f4 not found: ID does not exist"
Sep 10 19:46:49.585176 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.585146    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4cc443-e25f-48e3-8c13-e74b00defa5c-openshift-service-ca\") pod \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") "
Sep 10 19:46:49.585340 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.585203    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4nlg\" (UniqueName: \"kubernetes.io/projected/bb4cc443-e25f-48e3-8c13-e74b00defa5c-kube-api-access-l4nlg\") pod \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") "
Sep 10 19:46:49.585403 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.585385    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-metrics-certs\") pod \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") "
Sep 10 19:46:49.585458 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.585443    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls\") pod \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\" (UID: \"bb4cc443-e25f-48e3-8c13-e74b00defa5c\") "
Sep 10 19:46:49.585514 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.585492    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb4cc443-e25f-48e3-8c13-e74b00defa5c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb4cc443-e25f-48e3-8c13-e74b00defa5c" (UID: "bb4cc443-e25f-48e3-8c13-e74b00defa5c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:46:49.585808 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.585790    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4cc443-e25f-48e3-8c13-e74b00defa5c-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:49.587314 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.587292    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bb4cc443-e25f-48e3-8c13-e74b00defa5c" (UID: "bb4cc443-e25f-48e3-8c13-e74b00defa5c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:49.587424 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.587350    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4cc443-e25f-48e3-8c13-e74b00defa5c-kube-api-access-l4nlg" (OuterVolumeSpecName: "kube-api-access-l4nlg") pod "bb4cc443-e25f-48e3-8c13-e74b00defa5c" (UID: "bb4cc443-e25f-48e3-8c13-e74b00defa5c"). InnerVolumeSpecName "kube-api-access-l4nlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:46:49.587471 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.587420    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb4cc443-e25f-48e3-8c13-e74b00defa5c" (UID: "bb4cc443-e25f-48e3-8c13-e74b00defa5c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:46:49.686837 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.686810    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:49.686837 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.686836    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4nlg\" (UniqueName: \"kubernetes.io/projected/bb4cc443-e25f-48e3-8c13-e74b00defa5c-kube-api-access-l4nlg\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:49.687022 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.686846    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb4cc443-e25f-48e3-8c13-e74b00defa5c-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:46:49.761879 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.761803    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"]
Sep 10 19:46:49.766067 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:49.766042    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ecadb8-795b95db4d-tpdj9"]
Sep 10 19:46:51.657510 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:51.657472    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb4cc443-e25f-48e3-8c13-e74b00defa5c" path="/var/lib/kubelet/pods/bb4cc443-e25f-48e3-8c13-e74b00defa5c/volumes"
Sep 10 19:46:55.706870 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.706832    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"]
Sep 10 19:46:55.707261 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.707243    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb4cc443-e25f-48e3-8c13-e74b00defa5c" containerName="maas-api"
Sep 10 19:46:55.707261 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.707255    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb4cc443-e25f-48e3-8c13-e74b00defa5c" containerName="maas-api"
Sep 10 19:46:55.707343 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.707268    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b993a235-e4aa-4c3d-9db0-5cd2b4aae865" containerName="maas-api"
Sep 10 19:46:55.707343 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.707274    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b993a235-e4aa-4c3d-9db0-5cd2b4aae865" containerName="maas-api"
Sep 10 19:46:55.707445 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.707349    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb4cc443-e25f-48e3-8c13-e74b00defa5c" containerName="maas-api"
Sep 10 19:46:55.707445 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.707358    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b993a235-e4aa-4c3d-9db0-5cd2b4aae865" containerName="maas-api"
Sep 10 19:46:55.711744 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.711725    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.714426 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.714402    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-b588eb-serving-cert\""
Sep 10 19:46:55.725173 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.725146    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"]
Sep 10 19:46:55.846621 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.846585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24jdv\" (UniqueName: \"kubernetes.io/projected/c8bb26fa-112d-425a-b727-04871f8451b5-kube-api-access-24jdv\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.846803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.846693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.846803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.846724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8bb26fa-112d-425a-b727-04871f8451b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.846803 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.846743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-metrics-certs\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.947518 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.947481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8bb26fa-112d-425a-b727-04871f8451b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.947518 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.947517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-metrics-certs\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.947735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.947569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24jdv\" (UniqueName: \"kubernetes.io/projected/c8bb26fa-112d-425a-b727-04871f8451b5-kube-api-access-24jdv\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.947735 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.947718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.947838 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:55.947824    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-serving-cert: secret "maas-api-e2e-ipp-b-b588eb-serving-cert" not found
Sep 10 19:46:55.947900 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:46:55.947891    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls podName:c8bb26fa-112d-425a-b727-04871f8451b5 nodeName:}" failed. No retries permitted until 2026-09-10 19:46:56.447874323 +0000 UTC m=+1605.264483882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls") pod "maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x" (UID: "c8bb26fa-112d-425a-b727-04871f8451b5") : secret "maas-api-e2e-ipp-b-b588eb-serving-cert" not found
Sep 10 19:46:55.948260 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.948229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8bb26fa-112d-425a-b727-04871f8451b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.950230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.950208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-metrics-certs\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:55.955800 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:55.955780    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24jdv\" (UniqueName: \"kubernetes.io/projected/c8bb26fa-112d-425a-b727-04871f8451b5-kube-api-access-24jdv\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:56.452581 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:56.452539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:56.455098 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:56.455068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:56.624168 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:56.624132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:56.919690 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:56.919663    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"]
Sep 10 19:46:56.922421 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:46:56.922381    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8bb26fa_112d_425a_b727_04871f8451b5.slice/crio-546300b477f9385d0da10a71da9c073a59f4f130810530251de1c36a5cc16b50 WatchSource:0}: Error finding container 546300b477f9385d0da10a71da9c073a59f4f130810530251de1c36a5cc16b50: Status 404 returned error can't find the container with id 546300b477f9385d0da10a71da9c073a59f4f130810530251de1c36a5cc16b50
Sep 10 19:46:57.311299 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:57.311266    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"]
Sep 10 19:46:57.311572 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:57.311542    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy" containerID="cri-o://5839185ddb41a0946d5238d03ba1b64ce557b71b8655e65ccf2f8739431ac368" gracePeriod=30
Sep 10 19:46:57.494685 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:57.494645    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x" event={"ID":"c8bb26fa-112d-425a-b727-04871f8451b5","Type":"ContainerStarted","Data":"f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20"}
Sep 10 19:46:57.494890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:57.494713    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x" event={"ID":"c8bb26fa-112d-425a-b727-04871f8451b5","Type":"ContainerStarted","Data":"546300b477f9385d0da10a71da9c073a59f4f130810530251de1c36a5cc16b50"}
Sep 10 19:46:57.494890 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:57.494797    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:46:57.512642 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:46:57.512574    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x" podStartSLOduration=2.155543889 podStartE2EDuration="2.512550525s" totalImagesPullingTime="357.006636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:46:57.512133135 +0000 UTC m=+1606.328742730" watchObservedRunningTime="2026-09-10 19:46:57.512550525 +0000 UTC m=+1606.329160094"
Sep 10 19:47:02.527008 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.526975    2558 generic.go:356] "Generic (PLEG): container finished" podID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerID="5839185ddb41a0946d5238d03ba1b64ce557b71b8655e65ccf2f8739431ac368" exitCode=0
Sep 10 19:47:02.527471 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.527045    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" event={"ID":"95affc8c-27b4-41fb-9a10-eee9cf3eb406","Type":"ContainerDied","Data":"5839185ddb41a0946d5238d03ba1b64ce557b71b8655e65ccf2f8739431ac368"}
Sep 10 19:47:02.527471 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.527111    2558 scope.go:117] "RemoveContainer" containerID="dd024cc58c1b67a76a631d09a86e41d5a8950d31b005926d3395cac28f0bee1f"
Sep 10 19:47:02.569175 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.569152    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:47:02.714585 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714553    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-certs\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.714753 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714606    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-token\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.714753 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714638    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-socket\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.714753 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714666    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pvm7\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-kube-api-access-4pvm7\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.714753 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714686    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-credential-socket\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.714753 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714703    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istiod-ca-cert\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.714753 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-podinfo\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.715069 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714773    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-envoy\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.715069 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714801    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-data\") pod \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\" (UID: \"95affc8c-27b4-41fb-9a10-eee9cf3eb406\") "
Sep 10 19:47:02.715069 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.714866    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:02.715217 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.715068    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:02.715267 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.715225    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.715316 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.715274    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.715316 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.715288    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-data" (OuterVolumeSpecName: "istio-data") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:02.715465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.715307    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:02.715465 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.715415    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:47:02.716978 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.716955    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-token" (OuterVolumeSpecName: "istio-token") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:47:02.717091 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.717026    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-kube-api-access-4pvm7" (OuterVolumeSpecName: "kube-api-access-4pvm7") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "kube-api-access-4pvm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:47:02.717281 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.717255    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:47:02.717404 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.717360    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95affc8c-27b4-41fb-9a10-eee9cf3eb406" (UID: "95affc8c-27b4-41fb-9a10-eee9cf3eb406"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:47:02.816208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.816154    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.816208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.816182    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.816208 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.816198    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pvm7\" (UniqueName: \"kubernetes.io/projected/95affc8c-27b4-41fb-9a10-eee9cf3eb406-kube-api-access-4pvm7\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.816548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.816226    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.816548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.816238    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.816548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.816249    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:02.816548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:02.816260    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95affc8c-27b4-41fb-9a10-eee9cf3eb406-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:03.505782 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:03.505747    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:47:03.534188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:03.534129    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"
Sep 10 19:47:03.534188 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:03.534147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb" event={"ID":"95affc8c-27b4-41fb-9a10-eee9cf3eb406","Type":"ContainerDied","Data":"165188d27cec3491138dc827b687a8c7bd6c00e5c3c432daa07431cdb3ba4fd3"}
Sep 10 19:47:03.534726 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:03.534212    2558 scope.go:117] "RemoveContainer" containerID="5839185ddb41a0946d5238d03ba1b64ce557b71b8655e65ccf2f8739431ac368"
Sep 10 19:47:03.566914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:03.566879    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"]
Sep 10 19:47:03.570351 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:03.570315    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ecadb8-openshift-default-56957c4c48-pj6bb"]
Sep 10 19:47:03.657950 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:03.657915    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" path="/var/lib/kubelet/pods/95affc8c-27b4-41fb-9a10-eee9cf3eb406/volumes"
Sep 10 19:47:08.253194 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.253149    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"]
Sep 10 19:47:08.253703 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.253536    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" podUID="0d882fcb-e2f6-498f-ad6f-5dae6f86302e" containerName="maas-api" containerID="cri-o://86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0" gracePeriod=30
Sep 10 19:47:08.528169 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.528145    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:47:08.564808 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.564771    2558 generic.go:356] "Generic (PLEG): container finished" podID="0d882fcb-e2f6-498f-ad6f-5dae6f86302e" containerID="86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0" exitCode=0
Sep 10 19:47:08.564808 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.564810    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"
Sep 10 19:47:08.565014 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.564852    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" event={"ID":"0d882fcb-e2f6-498f-ad6f-5dae6f86302e","Type":"ContainerDied","Data":"86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0"}
Sep 10 19:47:08.565014 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.564908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t" event={"ID":"0d882fcb-e2f6-498f-ad6f-5dae6f86302e","Type":"ContainerDied","Data":"ae92fa959b1f7367d9c754920fe952345314fd3f3110f380fd8af14fa74683f1"}
Sep 10 19:47:08.565014 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.564938    2558 scope.go:117] "RemoveContainer" containerID="86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0"
Sep 10 19:47:08.570088 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.570067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj27l\" (UniqueName: \"kubernetes.io/projected/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-kube-api-access-zj27l\") pod \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") "
Sep 10 19:47:08.570230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.570114    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls\") pod \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") "
Sep 10 19:47:08.570230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.570184    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-openshift-service-ca\") pod \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") "
Sep 10 19:47:08.570230 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.570222    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-metrics-certs\") pod \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\" (UID: \"0d882fcb-e2f6-498f-ad6f-5dae6f86302e\") "
Sep 10 19:47:08.570987 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.570958    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d882fcb-e2f6-498f-ad6f-5dae6f86302e" (UID: "0d882fcb-e2f6-498f-ad6f-5dae6f86302e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:47:08.572426 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.572399    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-kube-api-access-zj27l" (OuterVolumeSpecName: "kube-api-access-zj27l") pod "0d882fcb-e2f6-498f-ad6f-5dae6f86302e" (UID: "0d882fcb-e2f6-498f-ad6f-5dae6f86302e"). InnerVolumeSpecName "kube-api-access-zj27l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:47:08.572684 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.572647    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d882fcb-e2f6-498f-ad6f-5dae6f86302e" (UID: "0d882fcb-e2f6-498f-ad6f-5dae6f86302e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:47:08.572780 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.572706    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d882fcb-e2f6-498f-ad6f-5dae6f86302e" (UID: "0d882fcb-e2f6-498f-ad6f-5dae6f86302e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:47:08.574881 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.574858    2558 scope.go:117] "RemoveContainer" containerID="86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0"
Sep 10 19:47:08.575220 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:47:08.575201    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0\": container with ID starting with 86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0 not found: ID does not exist" containerID="86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0"
Sep 10 19:47:08.575286 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.575233    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0"} err="failed to get container status \"86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0\": rpc error: code = NotFound desc = could not find container \"86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0\": container with ID starting with 86d50215756c4f1c635337442e089b467d926b31fd1944c4cd2ba93360d378c0 not found: ID does not exist"
Sep 10 19:47:08.671302 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.671269    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:08.671302 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.671298    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj27l\" (UniqueName: \"kubernetes.io/projected/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-kube-api-access-zj27l\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:08.671302 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.671310    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:08.671639 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.671319    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d882fcb-e2f6-498f-ad6f-5dae6f86302e-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:47:08.892725 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.892682    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"]
Sep 10 19:47:08.895218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:08.895191    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ff3019-765fd5b7b5-9874t"]
Sep 10 19:47:09.656281 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:09.656247    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d882fcb-e2f6-498f-ad6f-5dae6f86302e" path="/var/lib/kubelet/pods/0d882fcb-e2f6-498f-ad6f-5dae6f86302e/volumes"
Sep 10 19:47:24.358862 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:47:24.358834    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s46mh_256a7d14-aadc-43bd-b457-dc318fc6b539/payload-processing/0.log"
Sep 10 19:48:05.552507 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:05.552459    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s46mh_256a7d14-aadc-43bd-b457-dc318fc6b539/payload-processing/0.log"
Sep 10 19:48:06.356743 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.356715    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"]
Sep 10 19:48:06.357159 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357146    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy"
Sep 10 19:48:06.357213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357162    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy"
Sep 10 19:48:06.357213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357177    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy"
Sep 10 19:48:06.357213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357184    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy"
Sep 10 19:48:06.357213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357194    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d882fcb-e2f6-498f-ad6f-5dae6f86302e" containerName="maas-api"
Sep 10 19:48:06.357213 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357200    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d882fcb-e2f6-498f-ad6f-5dae6f86302e" containerName="maas-api"
Sep 10 19:48:06.357366 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357282    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy"
Sep 10 19:48:06.357366 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.357292    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d882fcb-e2f6-498f-ad6f-5dae6f86302e" containerName="maas-api"
Sep 10 19:48:06.360592 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.360573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.364226 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.364204    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-855446-openshift-default-dockercfg-hn5rp\""
Sep 10 19:48:06.388387 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.388352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"]
Sep 10 19:48:06.431166 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-podinfo\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431166 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-socket\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431400 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-data\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431400 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-certs\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431400 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9ll6\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-kube-api-access-v9ll6\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431400 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431328    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-envoy\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431559 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-credential-socket\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431559 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72e76643-1475-4a5c-824f-73ab27ed31dd-istiod-ca-cert\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.431559 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.431489    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-token\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532162 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-token\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532349 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-podinfo\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532349 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-socket\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532349 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532222    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-data\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532349 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-certs\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532349 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9ll6\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-kube-api-access-v9ll6\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-envoy\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-credential-socket\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532653 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72e76643-1475-4a5c-824f-73ab27ed31dd-istiod-ca-cert\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532816 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-certs\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532873 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-data\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.532873 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.532860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-socket\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.533047 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.533022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-credential-socket\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.533195 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.533178    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72e76643-1475-4a5c-824f-73ab27ed31dd-istiod-ca-cert\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.534797 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.534775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-envoy\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.534891 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.534868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-podinfo\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.553317 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.553289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-token\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.554747 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.554721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9ll6\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-kube-api-access-v9ll6\") pod \"e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") " pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.670994 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.670910    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:06.957982 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.957950    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"]
Sep 10 19:48:06.962538 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:48:06.962512    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e76643_1475_4a5c_824f_73ab27ed31dd.slice/crio-b9695b5df395d311279d13b6d1cbe23186ece51fb7f8b8d7fe7c8b550104c01f WatchSource:0}: Error finding container b9695b5df395d311279d13b6d1cbe23186ece51fb7f8b8d7fe7c8b550104c01f: Status 404 returned error can't find the container with id b9695b5df395d311279d13b6d1cbe23186ece51fb7f8b8d7fe7c8b550104c01f
Sep 10 19:48:06.964675 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.964643    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:48:06.964748 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.964706    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:48:06.964748 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:06.964738    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:48:07.898995 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:07.898953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" event={"ID":"72e76643-1475-4a5c-824f-73ab27ed31dd","Type":"ContainerStarted","Data":"93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a"}
Sep 10 19:48:07.899406 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:07.899017    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" event={"ID":"72e76643-1475-4a5c-824f-73ab27ed31dd","Type":"ContainerStarted","Data":"b9695b5df395d311279d13b6d1cbe23186ece51fb7f8b8d7fe7c8b550104c01f"}
Sep 10 19:48:07.931915 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:07.931858    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" podStartSLOduration=1.931843483 podStartE2EDuration="1.931843483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:48:07.930558648 +0000 UTC m=+1676.747168217" watchObservedRunningTime="2026-09-10 19:48:07.931843483 +0000 UTC m=+1676.748453107"
Sep 10 19:48:08.671467 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:08.671429    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:08.676848 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:08.676823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:08.904544 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:08.904514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:08.905498 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:08.905475    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:11.585468 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.585436    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"]
Sep 10 19:48:11.585921 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.585907    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95affc8c-27b4-41fb-9a10-eee9cf3eb406" containerName="istio-proxy"
Sep 10 19:48:11.589148 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.589125    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.594867 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.594847    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-855446-serving-cert\""
Sep 10 19:48:11.610041 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.610015    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"]
Sep 10 19:48:11.681828 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.681791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b798e-463e-42cb-a650-6837bb969ef2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.683418 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.681870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.683418 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.681962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frv4g\" (UniqueName: \"kubernetes.io/projected/f67b798e-463e-42cb-a650-6837bb969ef2-kube-api-access-frv4g\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.683418 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.681999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.783455 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.783417    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b798e-463e-42cb-a650-6837bb969ef2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.783627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.783485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.783627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.783546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frv4g\" (UniqueName: \"kubernetes.io/projected/f67b798e-463e-42cb-a650-6837bb969ef2-kube-api-access-frv4g\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.783627 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.783575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.784178 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.784154    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b798e-463e-42cb-a650-6837bb969ef2-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.785939 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.785919    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.786068 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.786047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.801139 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.801114    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frv4g\" (UniqueName: \"kubernetes.io/projected/f67b798e-463e-42cb-a650-6837bb969ef2-kube-api-access-frv4g\") pod \"maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:11.899926 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:11.899857    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:12.186078 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:12.186051    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"]
Sep 10 19:48:12.188003 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:48:12.187980    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67b798e_463e_42cb_a650_6837bb969ef2.slice/crio-bf25303f3a0578ef681d2d6614710211dad3b6f68bd86e3ee945c1973b525871 WatchSource:0}: Error finding container bf25303f3a0578ef681d2d6614710211dad3b6f68bd86e3ee945c1973b525871: Status 404 returned error can't find the container with id bf25303f3a0578ef681d2d6614710211dad3b6f68bd86e3ee945c1973b525871
Sep 10 19:48:12.927334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:12.927236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g" event={"ID":"f67b798e-463e-42cb-a650-6837bb969ef2","Type":"ContainerStarted","Data":"83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223"}
Sep 10 19:48:12.927334 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:12.927302    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g" event={"ID":"f67b798e-463e-42cb-a650-6837bb969ef2","Type":"ContainerStarted","Data":"bf25303f3a0578ef681d2d6614710211dad3b6f68bd86e3ee945c1973b525871"}
Sep 10 19:48:12.927834 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:12.927457    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:12.961002 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:12.960941    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g" podStartSLOduration=1.576599452 podStartE2EDuration="1.960924454s" totalImagesPullingTime="384.325002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:48:12.959458663 +0000 UTC m=+1681.776068250" watchObservedRunningTime="2026-09-10 19:48:12.960924454 +0000 UTC m=+1681.777534064"
Sep 10 19:48:18.943504 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:18.943468    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:29.024841 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:29.024802    2558 generic.go:356] "Generic (PLEG): container finished" podID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerID="93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a" exitCode=0
Sep 10 19:48:29.025310 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:29.024875    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" event={"ID":"72e76643-1475-4a5c-824f-73ab27ed31dd","Type":"ContainerDied","Data":"93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a"}
Sep 10 19:48:29.025310 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:29.025297    2558 scope.go:117] "RemoveContainer" containerID="93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a"
Sep 10 19:48:29.026464 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:29.026436    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:48:29.026524 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:29.026502    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:48:29.026565 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:29.026532    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 19:48:30.032316 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:30.032282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" event={"ID":"72e76643-1475-4a5c-824f-73ab27ed31dd","Type":"ContainerStarted","Data":"f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf"}
Sep 10 19:48:30.671306 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:30.671271    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:30.671518 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:30.671498    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 19:48:30.671566 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:30.671544    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 19:48:31.671843 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:31.671807    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 19:48:31.672342 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:31.671857    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 19:48:32.671831 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:32.671792    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 19:48:32.671998 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:32.671843    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 19:48:33.671387 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:33.671348    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 19:48:33.671566 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:33.671426    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 19:48:34.671797 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:34.671763    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 19:48:34.672194 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:34.671814    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 19:48:35.675593 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:35.675562    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:35.675980 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:35.675832    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:35.676454 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:35.676431    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:48:52.466814 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.466782    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"]
Sep 10 19:48:52.467318 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.466981    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g" podUID="f67b798e-463e-42cb-a650-6837bb969ef2" containerName="maas-api" containerID="cri-o://83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223" gracePeriod=30
Sep 10 19:48:52.719942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.719872    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:52.892310 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.892280    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-maas-api-tls\") pod \"f67b798e-463e-42cb-a650-6837bb969ef2\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") "
Sep 10 19:48:52.892511 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.892413    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b798e-463e-42cb-a650-6837bb969ef2-openshift-service-ca\") pod \"f67b798e-463e-42cb-a650-6837bb969ef2\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") "
Sep 10 19:48:52.892511 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.892494    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frv4g\" (UniqueName: \"kubernetes.io/projected/f67b798e-463e-42cb-a650-6837bb969ef2-kube-api-access-frv4g\") pod \"f67b798e-463e-42cb-a650-6837bb969ef2\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") "
Sep 10 19:48:52.892613 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.892528    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-metrics-certs\") pod \"f67b798e-463e-42cb-a650-6837bb969ef2\" (UID: \"f67b798e-463e-42cb-a650-6837bb969ef2\") "
Sep 10 19:48:52.892784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.892758    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f67b798e-463e-42cb-a650-6837bb969ef2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f67b798e-463e-42cb-a650-6837bb969ef2" (UID: "f67b798e-463e-42cb-a650-6837bb969ef2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:48:52.892872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.892855    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b798e-463e-42cb-a650-6837bb969ef2-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:48:52.894570 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.894536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f67b798e-463e-42cb-a650-6837bb969ef2" (UID: "f67b798e-463e-42cb-a650-6837bb969ef2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:48:52.894732 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.894706    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67b798e-463e-42cb-a650-6837bb969ef2-kube-api-access-frv4g" (OuterVolumeSpecName: "kube-api-access-frv4g") pod "f67b798e-463e-42cb-a650-6837bb969ef2" (UID: "f67b798e-463e-42cb-a650-6837bb969ef2"). InnerVolumeSpecName "kube-api-access-frv4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:48:52.894945 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.894920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f67b798e-463e-42cb-a650-6837bb969ef2" (UID: "f67b798e-463e-42cb-a650-6837bb969ef2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:48:52.993892 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.993804    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frv4g\" (UniqueName: \"kubernetes.io/projected/f67b798e-463e-42cb-a650-6837bb969ef2-kube-api-access-frv4g\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:48:52.993892 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.993839    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:48:52.993892 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:52.993851    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b798e-463e-42cb-a650-6837bb969ef2-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:48:53.176266 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.176233    2558 generic.go:356] "Generic (PLEG): container finished" podID="f67b798e-463e-42cb-a650-6837bb969ef2" containerID="83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223" exitCode=0
Sep 10 19:48:53.176472 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.176284    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"
Sep 10 19:48:53.176472 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.176320    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g" event={"ID":"f67b798e-463e-42cb-a650-6837bb969ef2","Type":"ContainerDied","Data":"83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223"}
Sep 10 19:48:53.176472 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.176391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g" event={"ID":"f67b798e-463e-42cb-a650-6837bb969ef2","Type":"ContainerDied","Data":"bf25303f3a0578ef681d2d6614710211dad3b6f68bd86e3ee945c1973b525871"}
Sep 10 19:48:53.176472 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.176421    2558 scope.go:117] "RemoveContainer" containerID="83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223"
Sep 10 19:48:53.186305 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.186287    2558 scope.go:117] "RemoveContainer" containerID="83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223"
Sep 10 19:48:53.186609 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:48:53.186592    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223\": container with ID starting with 83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223 not found: ID does not exist" containerID="83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223"
Sep 10 19:48:53.186678 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.186620    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223"} err="failed to get container status \"83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223\": rpc error: code = NotFound desc = could not find container \"83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223\": container with ID starting with 83436ba72f92bbf09bd1d2b0b6d83338a6c4b00bd080cc0b9725cc302a7c6223 not found: ID does not exist"
Sep 10 19:48:53.209363 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.209336    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"]
Sep 10 19:48:53.217090 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.217059    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-855446-76696dbb56-4br8g"]
Sep 10 19:48:53.663065 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:53.663029    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67b798e-463e-42cb-a650-6837bb969ef2" path="/var/lib/kubelet/pods/f67b798e-463e-42cb-a650-6837bb969ef2/volumes"
Sep 10 19:48:59.590976 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:59.590942    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"]
Sep 10 19:48:59.591426 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:48:59.591159    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy" containerID="cri-o://f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf" gracePeriod=30
Sep 10 19:49:04.848159 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.848132    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:49:04.905760 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.905681    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-token\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.905760 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.905721    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-socket\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.905760 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.905739    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72e76643-1475-4a5c-824f-73ab27ed31dd-istiod-ca-cert\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.906001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.905762    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-data\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.906001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.905898    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-credential-socket\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.906001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.905949    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-envoy\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.906001 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.905981    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9ll6\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-kube-api-access-v9ll6\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.906211 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906009    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-podinfo\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.906211 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906053    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-certs\") pod \"72e76643-1475-4a5c-824f-73ab27ed31dd\" (UID: \"72e76643-1475-4a5c-824f-73ab27ed31dd\") "
Sep 10 19:49:04.906211 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906061    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:49:04.906211 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906071    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:49:04.906211 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906180    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e76643-1475-4a5c-824f-73ab27ed31dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:49:04.906211 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906188    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:49:04.906533 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906511    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:04.906588 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906533    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72e76643-1475-4a5c-824f-73ab27ed31dd-istiod-ca-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:04.906588 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906547    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-data\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:04.906588 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906552    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:49:04.906588 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.906559    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-credential-socket\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:04.908041 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.908012    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:49:04.908159 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.908103    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:49:04.908159 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.908125    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 19:49:04.908232 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:04.908185    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-kube-api-access-v9ll6" (OuterVolumeSpecName: "kube-api-access-v9ll6") pod "72e76643-1475-4a5c-824f-73ab27ed31dd" (UID: "72e76643-1475-4a5c-824f-73ab27ed31dd"). InnerVolumeSpecName "kube-api-access-v9ll6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:49:05.007369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.007333    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-token\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:05.007369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.007361    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-envoy\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:05.007369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.007392    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9ll6\" (UniqueName: \"kubernetes.io/projected/72e76643-1475-4a5c-824f-73ab27ed31dd-kube-api-access-v9ll6\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:05.007369 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.007401    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72e76643-1475-4a5c-824f-73ab27ed31dd-istio-podinfo\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:05.007664 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.007410    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72e76643-1475-4a5c-824f-73ab27ed31dd-workload-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:05.249314 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.249282    2558 generic.go:356] "Generic (PLEG): container finished" podID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerID="f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf" exitCode=0
Sep 10 19:49:05.249497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.249337    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"
Sep 10 19:49:05.249497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.249341    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" event={"ID":"72e76643-1475-4a5c-824f-73ab27ed31dd","Type":"ContainerDied","Data":"f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf"}
Sep 10 19:49:05.249497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.249446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd" event={"ID":"72e76643-1475-4a5c-824f-73ab27ed31dd","Type":"ContainerDied","Data":"b9695b5df395d311279d13b6d1cbe23186ece51fb7f8b8d7fe7c8b550104c01f"}
Sep 10 19:49:05.249497 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.249482    2558 scope.go:117] "RemoveContainer" containerID="f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf"
Sep 10 19:49:05.259734 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.259674    2558 scope.go:117] "RemoveContainer" containerID="93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a"
Sep 10 19:49:05.268679 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.268659    2558 scope.go:117] "RemoveContainer" containerID="f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf"
Sep 10 19:49:05.268993 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:49:05.268972    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf\": container with ID starting with f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf not found: ID does not exist" containerID="f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf"
Sep 10 19:49:05.269057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.269001    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf"} err="failed to get container status \"f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf\": rpc error: code = NotFound desc = could not find container \"f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf\": container with ID starting with f00e8518e70a4a73a673e05f55cfb2da6072f5c73a9159986e2b692894ea67cf not found: ID does not exist"
Sep 10 19:49:05.269057 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.269019    2558 scope.go:117] "RemoveContainer" containerID="93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a"
Sep 10 19:49:05.269251 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:49:05.269231    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a\": container with ID starting with 93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a not found: ID does not exist" containerID="93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a"
Sep 10 19:49:05.269309 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.269259    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a"} err="failed to get container status \"93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a\": rpc error: code = NotFound desc = could not find container \"93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a\": container with ID starting with 93729cb5b088fdcbeb2cd36c6b3ffcc89574bd40802e579a0aceb873d9facb9a not found: ID does not exist"
Sep 10 19:49:05.274427 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.274405    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"]
Sep 10 19:49:05.279855 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.279832    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-855446-openshift-default-6db55dccb8-64tpd"]
Sep 10 19:49:05.656124 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:05.656046    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" path="/var/lib/kubelet/pods/72e76643-1475-4a5c-824f-73ab27ed31dd/volumes"
Sep 10 19:49:18.956527 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:18.956496    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"]
Sep 10 19:49:18.956958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:18.956728    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x" podUID="e78c2ea8-581c-4dec-8cfe-792deda0b38e" containerName="maas-api" containerID="cri-o://1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830" gracePeriod=30
Sep 10 19:49:19.214579 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.214511    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:49:19.336353 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.336320    2558 generic.go:356] "Generic (PLEG): container finished" podID="e78c2ea8-581c-4dec-8cfe-792deda0b38e" containerID="1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830" exitCode=0
Sep 10 19:49:19.336595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.336365    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"
Sep 10 19:49:19.336595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.336415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x" event={"ID":"e78c2ea8-581c-4dec-8cfe-792deda0b38e","Type":"ContainerDied","Data":"1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830"}
Sep 10 19:49:19.336595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.336550    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x" event={"ID":"e78c2ea8-581c-4dec-8cfe-792deda0b38e","Type":"ContainerDied","Data":"ecec8cede153c35a1512f9de7b794dbc3e0f0d70f77072309dd588099e83c3a6"}
Sep 10 19:49:19.336595 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.336572    2558 scope.go:117] "RemoveContainer" containerID="1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830"
Sep 10 19:49:19.347917 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.347890    2558 scope.go:117] "RemoveContainer" containerID="1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830"
Sep 10 19:49:19.348290 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:49:19.348268    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830\": container with ID starting with 1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830 not found: ID does not exist" containerID="1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830"
Sep 10 19:49:19.348448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.348302    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830"} err="failed to get container status \"1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830\": rpc error: code = NotFound desc = could not find container \"1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830\": container with ID starting with 1eff33711014eb004d3766062b6bcab26981f26d2c7660a468caa48aad4af830 not found: ID does not exist"
Sep 10 19:49:19.353416 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.353389    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls\") pod \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") "
Sep 10 19:49:19.353642 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.353625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzf6b\" (UniqueName: \"kubernetes.io/projected/e78c2ea8-581c-4dec-8cfe-792deda0b38e-kube-api-access-wzf6b\") pod \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") "
Sep 10 19:49:19.353794 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.353780    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78c2ea8-581c-4dec-8cfe-792deda0b38e-openshift-service-ca\") pod \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") "
Sep 10 19:49:19.353914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.353900    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-metrics-certs\") pod \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\" (UID: \"e78c2ea8-581c-4dec-8cfe-792deda0b38e\") "
Sep 10 19:49:19.354841 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.354809    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e78c2ea8-581c-4dec-8cfe-792deda0b38e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e78c2ea8-581c-4dec-8cfe-792deda0b38e" (UID: "e78c2ea8-581c-4dec-8cfe-792deda0b38e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:49:19.356439 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.356351    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e78c2ea8-581c-4dec-8cfe-792deda0b38e" (UID: "e78c2ea8-581c-4dec-8cfe-792deda0b38e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:49:19.356677 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.356650    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e78c2ea8-581c-4dec-8cfe-792deda0b38e-kube-api-access-wzf6b" (OuterVolumeSpecName: "kube-api-access-wzf6b") pod "e78c2ea8-581c-4dec-8cfe-792deda0b38e" (UID: "e78c2ea8-581c-4dec-8cfe-792deda0b38e"). InnerVolumeSpecName "kube-api-access-wzf6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:49:19.356774 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.356724    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e78c2ea8-581c-4dec-8cfe-792deda0b38e" (UID: "e78c2ea8-581c-4dec-8cfe-792deda0b38e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:49:19.455864 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.455833    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e78c2ea8-581c-4dec-8cfe-792deda0b38e-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:19.455864 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.455862    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:19.455864 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.455871    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e78c2ea8-581c-4dec-8cfe-792deda0b38e-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:19.456084 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.455880    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzf6b\" (UniqueName: \"kubernetes.io/projected/e78c2ea8-581c-4dec-8cfe-792deda0b38e-kube-api-access-wzf6b\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:49:19.667913 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.667883    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"]
Sep 10 19:49:19.670285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:19.670265    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-836291-7687db598b-4gh2x"]
Sep 10 19:49:21.656829 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:49:21.656800    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e78c2ea8-581c-4dec-8cfe-792deda0b38e" path="/var/lib/kubelet/pods/e78c2ea8-581c-4dec-8cfe-792deda0b38e/volumes"
Sep 10 19:50:34.127697 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.127655    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"]
Sep 10 19:50:34.128239 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.127866    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x" podUID="c8bb26fa-112d-425a-b727-04871f8451b5" containerName="maas-api" containerID="cri-o://f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20" gracePeriod=30
Sep 10 19:50:34.387737 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.387680    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:50:34.465025 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.464990    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls\") pod \"c8bb26fa-112d-425a-b727-04871f8451b5\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") "
Sep 10 19:50:34.465187 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.465080    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8bb26fa-112d-425a-b727-04871f8451b5-openshift-service-ca\") pod \"c8bb26fa-112d-425a-b727-04871f8451b5\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") "
Sep 10 19:50:34.465187 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.465172    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24jdv\" (UniqueName: \"kubernetes.io/projected/c8bb26fa-112d-425a-b727-04871f8451b5-kube-api-access-24jdv\") pod \"c8bb26fa-112d-425a-b727-04871f8451b5\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") "
Sep 10 19:50:34.465273 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.465231    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-metrics-certs\") pod \"c8bb26fa-112d-425a-b727-04871f8451b5\" (UID: \"c8bb26fa-112d-425a-b727-04871f8451b5\") "
Sep 10 19:50:34.465507 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.465478    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8bb26fa-112d-425a-b727-04871f8451b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8bb26fa-112d-425a-b727-04871f8451b5" (UID: "c8bb26fa-112d-425a-b727-04871f8451b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:50:34.465622 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.465566    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8bb26fa-112d-425a-b727-04871f8451b5-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:34.467149 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.467118    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8bb26fa-112d-425a-b727-04871f8451b5" (UID: "c8bb26fa-112d-425a-b727-04871f8451b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:50:34.467257 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.467186    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8bb26fa-112d-425a-b727-04871f8451b5-kube-api-access-24jdv" (OuterVolumeSpecName: "kube-api-access-24jdv") pod "c8bb26fa-112d-425a-b727-04871f8451b5" (UID: "c8bb26fa-112d-425a-b727-04871f8451b5"). InnerVolumeSpecName "kube-api-access-24jdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:50:34.467257 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.467207    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c8bb26fa-112d-425a-b727-04871f8451b5" (UID: "c8bb26fa-112d-425a-b727-04871f8451b5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:50:34.566872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.566836    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:34.566872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.566866    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24jdv\" (UniqueName: \"kubernetes.io/projected/c8bb26fa-112d-425a-b727-04871f8451b5-kube-api-access-24jdv\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:34.566872 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.566877    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8bb26fa-112d-425a-b727-04871f8451b5-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:34.772499 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.772463    2558 generic.go:356] "Generic (PLEG): container finished" podID="c8bb26fa-112d-425a-b727-04871f8451b5" containerID="f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20" exitCode=0
Sep 10 19:50:34.772673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.772512    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"
Sep 10 19:50:34.772673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.772548    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x" event={"ID":"c8bb26fa-112d-425a-b727-04871f8451b5","Type":"ContainerDied","Data":"f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20"}
Sep 10 19:50:34.772673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.772597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x" event={"ID":"c8bb26fa-112d-425a-b727-04871f8451b5","Type":"ContainerDied","Data":"546300b477f9385d0da10a71da9c073a59f4f130810530251de1c36a5cc16b50"}
Sep 10 19:50:34.772673 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.772618    2558 scope.go:117] "RemoveContainer" containerID="f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20"
Sep 10 19:50:34.782739 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.782721    2558 scope.go:117] "RemoveContainer" containerID="f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20"
Sep 10 19:50:34.782984 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:50:34.782967    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20\": container with ID starting with f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20 not found: ID does not exist" containerID="f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20"
Sep 10 19:50:34.783039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.782991    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20"} err="failed to get container status \"f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20\": rpc error: code = NotFound desc = could not find container \"f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20\": container with ID starting with f13a5648fc947548a4208735a1275bc7a7e20e4af656969718115ea7371d1d20 not found: ID does not exist"
Sep 10 19:50:34.818180 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.818139    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"]
Sep 10 19:50:34.820501 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:34.820482    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b588eb-76bbc99948-cc67x"]
Sep 10 19:50:35.656044 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:35.656009    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8bb26fa-112d-425a-b727-04871f8451b5" path="/var/lib/kubelet/pods/c8bb26fa-112d-425a-b727-04871f8451b5/volumes"
Sep 10 19:50:52.315420 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.315360    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"]
Sep 10 19:50:52.316003 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.315628    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t" podUID="3273021d-e959-4628-86a7-dac7b887ac74" containerName="maas-api" containerID="cri-o://27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958" gracePeriod=30
Sep 10 19:50:52.571895 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.571830    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:50:52.642615 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.642585    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfkfb\" (UniqueName: \"kubernetes.io/projected/3273021d-e959-4628-86a7-dac7b887ac74-kube-api-access-pfkfb\") pod \"3273021d-e959-4628-86a7-dac7b887ac74\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") "
Sep 10 19:50:52.642615 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.642620    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-maas-api-tls\") pod \"3273021d-e959-4628-86a7-dac7b887ac74\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") "
Sep 10 19:50:52.642836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.642671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3273021d-e959-4628-86a7-dac7b887ac74-openshift-service-ca\") pod \"3273021d-e959-4628-86a7-dac7b887ac74\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") "
Sep 10 19:50:52.642836 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.642788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-metrics-certs\") pod \"3273021d-e959-4628-86a7-dac7b887ac74\" (UID: \"3273021d-e959-4628-86a7-dac7b887ac74\") "
Sep 10 19:50:52.643055 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.643027    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3273021d-e959-4628-86a7-dac7b887ac74-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3273021d-e959-4628-86a7-dac7b887ac74" (UID: "3273021d-e959-4628-86a7-dac7b887ac74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:50:52.643187 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.643093    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3273021d-e959-4628-86a7-dac7b887ac74-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:52.644840 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.644801    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3273021d-e959-4628-86a7-dac7b887ac74" (UID: "3273021d-e959-4628-86a7-dac7b887ac74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:50:52.644930 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.644805    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3273021d-e959-4628-86a7-dac7b887ac74-kube-api-access-pfkfb" (OuterVolumeSpecName: "kube-api-access-pfkfb") pod "3273021d-e959-4628-86a7-dac7b887ac74" (UID: "3273021d-e959-4628-86a7-dac7b887ac74"). InnerVolumeSpecName "kube-api-access-pfkfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:50:52.644930 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.644868    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3273021d-e959-4628-86a7-dac7b887ac74" (UID: "3273021d-e959-4628-86a7-dac7b887ac74"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:50:52.743482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.743453    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfkfb\" (UniqueName: \"kubernetes.io/projected/3273021d-e959-4628-86a7-dac7b887ac74-kube-api-access-pfkfb\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:52.743482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.743479    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:52.743482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.743489    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3273021d-e959-4628-86a7-dac7b887ac74-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:50:52.876096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.876006    2558 generic.go:356] "Generic (PLEG): container finished" podID="3273021d-e959-4628-86a7-dac7b887ac74" containerID="27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958" exitCode=0
Sep 10 19:50:52.876096 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.876057    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"
Sep 10 19:50:52.876278 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.876092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t" event={"ID":"3273021d-e959-4628-86a7-dac7b887ac74","Type":"ContainerDied","Data":"27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958"}
Sep 10 19:50:52.876278 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.876152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t" event={"ID":"3273021d-e959-4628-86a7-dac7b887ac74","Type":"ContainerDied","Data":"cb343e1b4bf03d4c17c271a34c374251ef1993e1f8d8ba9f77447c309240c283"}
Sep 10 19:50:52.876278 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.876174    2558 scope.go:117] "RemoveContainer" containerID="27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958"
Sep 10 19:50:52.886339 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.886322    2558 scope.go:117] "RemoveContainer" containerID="27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958"
Sep 10 19:50:52.886636 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:50:52.886617    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958\": container with ID starting with 27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958 not found: ID does not exist" containerID="27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958"
Sep 10 19:50:52.886695 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.886644    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958"} err="failed to get container status \"27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958\": rpc error: code = NotFound desc = could not find container \"27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958\": container with ID starting with 27db85b94c963c5b56e7ff1aae608ec9894d60b0f1dc22ad623ed0543c041958 not found: ID does not exist"
Sep 10 19:50:52.908410 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.908383    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"]
Sep 10 19:50:52.910776 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:52.910755    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-07c5fe-6d584d884b-7kr2t"]
Sep 10 19:50:53.656629 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:50:53.656583    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3273021d-e959-4628-86a7-dac7b887ac74" path="/var/lib/kubelet/pods/3273021d-e959-4628-86a7-dac7b887ac74/volumes"
Sep 10 19:51:10.651893 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.651863    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"]
Sep 10 19:51:10.652368 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.652093    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" podUID="88167b78-1c33-47bf-9f70-5a139de2b02f" containerName="maas-api" containerID="cri-o://3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538" gracePeriod=30
Sep 10 19:51:10.822628 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.822588    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" podUID="88167b78-1c33-47bf-9f70-5a139de2b02f" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.65:8443/health\": dial tcp 10.133.0.65:8443: connect: connection refused"
Sep 10 19:51:10.911416 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.911343    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:51:10.979804 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.979770    2558 generic.go:356] "Generic (PLEG): container finished" podID="88167b78-1c33-47bf-9f70-5a139de2b02f" containerID="3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538" exitCode=0
Sep 10 19:51:10.979987 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.979812    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"
Sep 10 19:51:10.979987 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.979849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" event={"ID":"88167b78-1c33-47bf-9f70-5a139de2b02f","Type":"ContainerDied","Data":"3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538"}
Sep 10 19:51:10.979987 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.979903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4" event={"ID":"88167b78-1c33-47bf-9f70-5a139de2b02f","Type":"ContainerDied","Data":"c2de2bf576a22aab60e987fd1dcede14cae2b8f6445d909579d142b1045918ca"}
Sep 10 19:51:10.979987 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.979925    2558 scope.go:117] "RemoveContainer" containerID="3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538"
Sep 10 19:51:10.989247 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.989234    2558 scope.go:117] "RemoveContainer" containerID="3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538"
Sep 10 19:51:10.989663 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:51:10.989642    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538\": container with ID starting with 3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538 not found: ID does not exist" containerID="3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538"
Sep 10 19:51:10.989737 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:10.989678    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538"} err="failed to get container status \"3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538\": rpc error: code = NotFound desc = could not find container \"3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538\": container with ID starting with 3434fafa0ea254c42503b48665ef9583a30aa3eeb849f4e9603dfda7b7224538 not found: ID does not exist"
Sep 10 19:51:11.026346 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.026313    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgnkj\" (UniqueName: \"kubernetes.io/projected/88167b78-1c33-47bf-9f70-5a139de2b02f-kube-api-access-tgnkj\") pod \"88167b78-1c33-47bf-9f70-5a139de2b02f\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") "
Sep 10 19:51:11.026507 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.026394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88167b78-1c33-47bf-9f70-5a139de2b02f-openshift-service-ca\") pod \"88167b78-1c33-47bf-9f70-5a139de2b02f\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") "
Sep 10 19:51:11.026577 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.026552    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls\") pod \"88167b78-1c33-47bf-9f70-5a139de2b02f\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") "
Sep 10 19:51:11.026635 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.026584    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-metrics-certs\") pod \"88167b78-1c33-47bf-9f70-5a139de2b02f\" (UID: \"88167b78-1c33-47bf-9f70-5a139de2b02f\") "
Sep 10 19:51:11.026765 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.026745    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88167b78-1c33-47bf-9f70-5a139de2b02f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88167b78-1c33-47bf-9f70-5a139de2b02f" (UID: "88167b78-1c33-47bf-9f70-5a139de2b02f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:51:11.026953 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.026937    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88167b78-1c33-47bf-9f70-5a139de2b02f-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:51:11.028396 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.028361    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88167b78-1c33-47bf-9f70-5a139de2b02f-kube-api-access-tgnkj" (OuterVolumeSpecName: "kube-api-access-tgnkj") pod "88167b78-1c33-47bf-9f70-5a139de2b02f" (UID: "88167b78-1c33-47bf-9f70-5a139de2b02f"). InnerVolumeSpecName "kube-api-access-tgnkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:51:11.028509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.028488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "88167b78-1c33-47bf-9f70-5a139de2b02f" (UID: "88167b78-1c33-47bf-9f70-5a139de2b02f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:51:11.028573 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.028507    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88167b78-1c33-47bf-9f70-5a139de2b02f" (UID: "88167b78-1c33-47bf-9f70-5a139de2b02f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:51:11.128391 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.128350    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgnkj\" (UniqueName: \"kubernetes.io/projected/88167b78-1c33-47bf-9f70-5a139de2b02f-kube-api-access-tgnkj\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:51:11.128568 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.128406    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:51:11.128568 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.128417    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88167b78-1c33-47bf-9f70-5a139de2b02f-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:51:11.303811 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.303773    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"]
Sep 10 19:51:11.310764 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.310737    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-2a1fa9-f64cc7569-kbvb4"]
Sep 10 19:51:11.657220 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:11.657142    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88167b78-1c33-47bf-9f70-5a139de2b02f" path="/var/lib/kubelet/pods/88167b78-1c33-47bf-9f70-5a139de2b02f/volumes"
Sep 10 19:51:20.812938 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:20.812904    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-v29nl"]
Sep 10 19:51:20.813331 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:20.813109    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79fcf5569f-v29nl" podUID="8d9d7211-e594-4051-a529-64893809fdf8" containerName="manager" containerID="cri-o://51f9f1957ad12c5b5e1d9f7f7851ccddc65422e225f8ffe3a29077ea5b4826fb" gracePeriod=30
Sep 10 19:51:21.039236 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.039206    2558 generic.go:356] "Generic (PLEG): container finished" podID="8d9d7211-e594-4051-a529-64893809fdf8" containerID="51f9f1957ad12c5b5e1d9f7f7851ccddc65422e225f8ffe3a29077ea5b4826fb" exitCode=0
Sep 10 19:51:21.039347 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.039275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-v29nl" event={"ID":"8d9d7211-e594-4051-a529-64893809fdf8","Type":"ContainerDied","Data":"51f9f1957ad12c5b5e1d9f7f7851ccddc65422e225f8ffe3a29077ea5b4826fb"}
Sep 10 19:51:21.059039 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.059016    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:51:21.228216 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.228189    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-webhook-cert\") pod \"8d9d7211-e594-4051-a529-64893809fdf8\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") "
Sep 10 19:51:21.228411 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.228290    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rtpx\" (UniqueName: \"kubernetes.io/projected/8d9d7211-e594-4051-a529-64893809fdf8-kube-api-access-6rtpx\") pod \"8d9d7211-e594-4051-a529-64893809fdf8\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") "
Sep 10 19:51:21.228411 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.228329    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs\") pod \"8d9d7211-e594-4051-a529-64893809fdf8\" (UID: \"8d9d7211-e594-4051-a529-64893809fdf8\") "
Sep 10 19:51:21.230509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.230469    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8d9d7211-e594-4051-a529-64893809fdf8" (UID: "8d9d7211-e594-4051-a529-64893809fdf8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:51:21.230509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.230477    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8d9d7211-e594-4051-a529-64893809fdf8" (UID: "8d9d7211-e594-4051-a529-64893809fdf8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:51:21.230509 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.230500    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d9d7211-e594-4051-a529-64893809fdf8-kube-api-access-6rtpx" (OuterVolumeSpecName: "kube-api-access-6rtpx") pod "8d9d7211-e594-4051-a529-64893809fdf8" (UID: "8d9d7211-e594-4051-a529-64893809fdf8"). InnerVolumeSpecName "kube-api-access-6rtpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:51:21.329662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.329629    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-webhook-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:51:21.329662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.329656    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rtpx\" (UniqueName: \"kubernetes.io/projected/8d9d7211-e594-4051-a529-64893809fdf8-kube-api-access-6rtpx\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:51:21.329662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:21.329665    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9d7211-e594-4051-a529-64893809fdf8-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:51:22.047919 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:22.047892    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-v29nl"
Sep 10 19:51:22.047919 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:22.047908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-v29nl" event={"ID":"8d9d7211-e594-4051-a529-64893809fdf8","Type":"ContainerDied","Data":"5048025266b7235cb0c28fef3802817cd19e4538b324b12f9832928de943260c"}
Sep 10 19:51:22.048475 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:22.047969    2558 scope.go:117] "RemoveContainer" containerID="51f9f1957ad12c5b5e1d9f7f7851ccddc65422e225f8ffe3a29077ea5b4826fb"
Sep 10 19:51:22.065963 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:22.065937    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-v29nl"]
Sep 10 19:51:22.068174 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:22.068152    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-v29nl"]
Sep 10 19:51:23.655261 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:51:23.655227    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d9d7211-e594-4051-a529-64893809fdf8" path="/var/lib/kubelet/pods/8d9d7211-e594-4051-a529-64893809fdf8/volumes"
Sep 10 19:52:22.918113 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918049    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79fcf5569f-nmwcb"]
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918670    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3273021d-e959-4628-86a7-dac7b887ac74" containerName="maas-api"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918698    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3273021d-e959-4628-86a7-dac7b887ac74" containerName="maas-api"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918714    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d9d7211-e594-4051-a529-64893809fdf8" containerName="manager"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918723    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d9d7211-e594-4051-a529-64893809fdf8" containerName="manager"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918741    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918750    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918759    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e78c2ea8-581c-4dec-8cfe-792deda0b38e" containerName="maas-api"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918768    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e78c2ea8-581c-4dec-8cfe-792deda0b38e" containerName="maas-api"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918781    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67b798e-463e-42cb-a650-6837bb969ef2" containerName="maas-api"
Sep 10 19:52:22.918787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918788    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67b798e-463e-42cb-a650-6837bb969ef2" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918810    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88167b78-1c33-47bf-9f70-5a139de2b02f" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918818    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="88167b78-1c33-47bf-9f70-5a139de2b02f" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918832    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8bb26fa-112d-425a-b727-04871f8451b5" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918840    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8bb26fa-112d-425a-b727-04871f8451b5" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918934    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="88167b78-1c33-47bf-9f70-5a139de2b02f" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918943    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d9d7211-e594-4051-a529-64893809fdf8" containerName="manager"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918950    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3273021d-e959-4628-86a7-dac7b887ac74" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918956    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67b798e-463e-42cb-a650-6837bb969ef2" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918962    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918968    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e78c2ea8-581c-4dec-8cfe-792deda0b38e" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918973    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8bb26fa-112d-425a-b727-04871f8451b5" containerName="maas-api"
Sep 10 19:52:22.919165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.918979    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy"
Sep 10 19:52:22.921975 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.921958    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:22.924344 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.924323    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 19:52:22.925075 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.925058    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6znfw\""
Sep 10 19:52:22.925165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.925100    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 19:52:22.925232 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.925213    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 19:52:22.940524 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.940493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-nmwcb"]
Sep 10 19:52:22.974815 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.974782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6ct\" (UniqueName: \"kubernetes.io/projected/590eaa44-c334-4f4c-9dcc-5734fabed917-kube-api-access-qb6ct\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:22.974977 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.974881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-webhook-cert\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:22.974977 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:22.974909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-metrics-certs\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.075439 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.075405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6ct\" (UniqueName: \"kubernetes.io/projected/590eaa44-c334-4f4c-9dcc-5734fabed917-kube-api-access-qb6ct\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.075629 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.075478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-webhook-cert\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.075629 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.075499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-metrics-certs\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.077972 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.077943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-metrics-certs\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.078085 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.077974    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-webhook-cert\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.083764 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.083738    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6ct\" (UniqueName: \"kubernetes.io/projected/590eaa44-c334-4f4c-9dcc-5734fabed917-kube-api-access-qb6ct\") pod \"maas-controller-79fcf5569f-nmwcb\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") " pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.237883 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.237846    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:23.508989 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.508961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-nmwcb"]
Sep 10 19:52:23.510388 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:52:23.510351    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590eaa44_c334_4f4c_9dcc_5734fabed917.slice/crio-a9ecd427b77765707948661ddb771759bd7773d92b6881d4b6bc8b0a78498d9e WatchSource:0}: Error finding container a9ecd427b77765707948661ddb771759bd7773d92b6881d4b6bc8b0a78498d9e: Status 404 returned error can't find the container with id a9ecd427b77765707948661ddb771759bd7773d92b6881d4b6bc8b0a78498d9e
Sep 10 19:52:23.511739 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:23.511723    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 19:52:24.390867 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:24.390774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-nmwcb" event={"ID":"590eaa44-c334-4f4c-9dcc-5734fabed917","Type":"ContainerStarted","Data":"4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81"}
Sep 10 19:52:24.390867 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:24.390844    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:24.390867 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:24.390864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-nmwcb" event={"ID":"590eaa44-c334-4f4c-9dcc-5734fabed917","Type":"ContainerStarted","Data":"a9ecd427b77765707948661ddb771759bd7773d92b6881d4b6bc8b0a78498d9e"}
Sep 10 19:52:24.408222 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:24.408164    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79fcf5569f-nmwcb" podStartSLOduration=1.8863333039999999 podStartE2EDuration="2.40814764s" totalImagesPullingTime="521.814336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:52:24.406399382 +0000 UTC m=+1933.223008949" watchObservedRunningTime="2026-09-10 19:52:24.40814764 +0000 UTC m=+1933.224757233"
Sep 10 19:52:35.398313 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:35.398281    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:44.740229 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:44.740188    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-nmwcb"]
Sep 10 19:52:44.740751 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:44.740464    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79fcf5569f-nmwcb" podUID="590eaa44-c334-4f4c-9dcc-5734fabed917" containerName="manager" containerID="cri-o://4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81" gracePeriod=30
Sep 10 19:52:44.988847 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:44.988822    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:45.085246 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.085164    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-metrics-certs\") pod \"590eaa44-c334-4f4c-9dcc-5734fabed917\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") "
Sep 10 19:52:45.085246 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.085226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb6ct\" (UniqueName: \"kubernetes.io/projected/590eaa44-c334-4f4c-9dcc-5734fabed917-kube-api-access-qb6ct\") pod \"590eaa44-c334-4f4c-9dcc-5734fabed917\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") "
Sep 10 19:52:45.085490 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.085308    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-webhook-cert\") pod \"590eaa44-c334-4f4c-9dcc-5734fabed917\" (UID: \"590eaa44-c334-4f4c-9dcc-5734fabed917\") "
Sep 10 19:52:45.087367 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.087341    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/590eaa44-c334-4f4c-9dcc-5734fabed917-kube-api-access-qb6ct" (OuterVolumeSpecName: "kube-api-access-qb6ct") pod "590eaa44-c334-4f4c-9dcc-5734fabed917" (UID: "590eaa44-c334-4f4c-9dcc-5734fabed917"). InnerVolumeSpecName "kube-api-access-qb6ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:52:45.088046 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.088021    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "590eaa44-c334-4f4c-9dcc-5734fabed917" (UID: "590eaa44-c334-4f4c-9dcc-5734fabed917"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:52:45.088089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.088042    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "590eaa44-c334-4f4c-9dcc-5734fabed917" (UID: "590eaa44-c334-4f4c-9dcc-5734fabed917"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:52:45.186482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.186444    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:52:45.186482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.186480    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb6ct\" (UniqueName: \"kubernetes.io/projected/590eaa44-c334-4f4c-9dcc-5734fabed917-kube-api-access-qb6ct\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:52:45.186482 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.186492    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/590eaa44-c334-4f4c-9dcc-5734fabed917-webhook-cert\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:52:45.503996 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.503960    2558 generic.go:356] "Generic (PLEG): container finished" podID="590eaa44-c334-4f4c-9dcc-5734fabed917" containerID="4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81" exitCode=0
Sep 10 19:52:45.504154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.504007    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-nmwcb"
Sep 10 19:52:45.504154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.504023    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-nmwcb" event={"ID":"590eaa44-c334-4f4c-9dcc-5734fabed917","Type":"ContainerDied","Data":"4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81"}
Sep 10 19:52:45.504154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.504075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-nmwcb" event={"ID":"590eaa44-c334-4f4c-9dcc-5734fabed917","Type":"ContainerDied","Data":"a9ecd427b77765707948661ddb771759bd7773d92b6881d4b6bc8b0a78498d9e"}
Sep 10 19:52:45.504154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.504106    2558 scope.go:117] "RemoveContainer" containerID="4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81"
Sep 10 19:52:45.513662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.513640    2558 scope.go:117] "RemoveContainer" containerID="4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81"
Sep 10 19:52:45.513915 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:52:45.513894    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81\": container with ID starting with 4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81 not found: ID does not exist" containerID="4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81"
Sep 10 19:52:45.513983 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.513921    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81"} err="failed to get container status \"4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81\": rpc error: code = NotFound desc = could not find container \"4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81\": container with ID starting with 4c0b7852b497411040d0d495b186768b560b4738783f6ed26a284118e9652f81 not found: ID does not exist"
Sep 10 19:52:45.525662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.525638    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-nmwcb"]
Sep 10 19:52:45.530748 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.530725    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-nmwcb"]
Sep 10 19:52:45.656077 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:45.656039    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="590eaa44-c334-4f4c-9dcc-5734fabed917" path="/var/lib/kubelet/pods/590eaa44-c334-4f4c-9dcc-5734fabed917/volumes"
Sep 10 19:52:46.639184 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.639147    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79fcf5569f-7sp94"]
Sep 10 19:52:46.639650 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.639632    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="590eaa44-c334-4f4c-9dcc-5734fabed917" containerName="manager"
Sep 10 19:52:46.639701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.639652    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="590eaa44-c334-4f4c-9dcc-5734fabed917" containerName="manager"
Sep 10 19:52:46.639701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.639670    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy"
Sep 10 19:52:46.639701 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.639676    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e76643-1475-4a5c-824f-73ab27ed31dd" containerName="istio-proxy"
Sep 10 19:52:46.639809 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.639744    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="590eaa44-c334-4f4c-9dcc-5734fabed917" containerName="manager"
Sep 10 19:52:46.644154 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.644130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.647205 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.647168    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 19:52:46.647205 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.647191    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 19:52:46.647444 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.647214    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6znfw\""
Sep 10 19:52:46.647444 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.647200    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 19:52:46.652225 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.651927    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-7sp94"]
Sep 10 19:52:46.799390 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.799340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2lvw\" (UniqueName: \"kubernetes.io/projected/9b40ebb5-a668-4170-909e-7bddd2d92154-kube-api-access-l2lvw\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.799598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.799440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b40ebb5-a668-4170-909e-7bddd2d92154-webhook-cert\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.799598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.799489    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40ebb5-a668-4170-909e-7bddd2d92154-metrics-certs\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.900347 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.900251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2lvw\" (UniqueName: \"kubernetes.io/projected/9b40ebb5-a668-4170-909e-7bddd2d92154-kube-api-access-l2lvw\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.900347 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.900299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b40ebb5-a668-4170-909e-7bddd2d92154-webhook-cert\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.900347 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.900325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40ebb5-a668-4170-909e-7bddd2d92154-metrics-certs\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.902851 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.902825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40ebb5-a668-4170-909e-7bddd2d92154-metrics-certs\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.902961 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.902853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b40ebb5-a668-4170-909e-7bddd2d92154-webhook-cert\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.908209 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.908185    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2lvw\" (UniqueName: \"kubernetes.io/projected/9b40ebb5-a668-4170-909e-7bddd2d92154-kube-api-access-l2lvw\") pod \"maas-controller-79fcf5569f-7sp94\" (UID: \"9b40ebb5-a668-4170-909e-7bddd2d92154\") " pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:46.955914 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:46.955884    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:47.232451 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:47.232418    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fcf5569f-7sp94"]
Sep 10 19:52:47.234574 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:52:47.234549    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b40ebb5_a668_4170_909e_7bddd2d92154.slice/crio-b6cc79ade9d8db2ff8c49263080f4b5e0da8c8bbdd3c1b1b967127e8a5c1aa5a WatchSource:0}: Error finding container b6cc79ade9d8db2ff8c49263080f4b5e0da8c8bbdd3c1b1b967127e8a5c1aa5a: Status 404 returned error can't find the container with id b6cc79ade9d8db2ff8c49263080f4b5e0da8c8bbdd3c1b1b967127e8a5c1aa5a
Sep 10 19:52:47.520662 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:47.520574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-7sp94" event={"ID":"9b40ebb5-a668-4170-909e-7bddd2d92154","Type":"ContainerStarted","Data":"b6cc79ade9d8db2ff8c49263080f4b5e0da8c8bbdd3c1b1b967127e8a5c1aa5a"}
Sep 10 19:52:48.527684 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:48.527646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fcf5569f-7sp94" event={"ID":"9b40ebb5-a668-4170-909e-7bddd2d92154","Type":"ContainerStarted","Data":"49cf4a435188a66dc76d2574730a33c99b13ae7d65faf7814e5abf14c5c23500"}
Sep 10 19:52:48.528270 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:48.527719    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:52:48.548153 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:48.548097    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79fcf5569f-7sp94" podStartSLOduration=2.135465797 podStartE2EDuration="2.54808226s" totalImagesPullingTime="412.616463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:52:48.545416279 +0000 UTC m=+1957.362025868" watchObservedRunningTime="2026-09-10 19:52:48.54808226 +0000 UTC m=+1957.364691828"
Sep 10 19:52:59.536610 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:52:59.536573    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79fcf5569f-7sp94"
Sep 10 19:53:59.445880 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.445844    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"]
Sep 10 19:53:59.450406 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.446746    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb" podUID="ef06d418-05ae-4e95-a14f-44de679566f9" containerName="manager" containerID="cri-o://caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07" gracePeriod=10
Sep 10 19:53:59.801880 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.801854    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:53:59.891767 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.891732    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef06d418-05ae-4e95-a14f-44de679566f9-extensions-socket-volume\") pod \"ef06d418-05ae-4e95-a14f-44de679566f9\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") "
Sep 10 19:53:59.891958 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.891784    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8shnv\" (UniqueName: \"kubernetes.io/projected/ef06d418-05ae-4e95-a14f-44de679566f9-kube-api-access-8shnv\") pod \"ef06d418-05ae-4e95-a14f-44de679566f9\" (UID: \"ef06d418-05ae-4e95-a14f-44de679566f9\") "
Sep 10 19:53:59.892127 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.892097    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef06d418-05ae-4e95-a14f-44de679566f9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef06d418-05ae-4e95-a14f-44de679566f9" (UID: "ef06d418-05ae-4e95-a14f-44de679566f9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 19:53:59.894038 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.894003    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef06d418-05ae-4e95-a14f-44de679566f9-kube-api-access-8shnv" (OuterVolumeSpecName: "kube-api-access-8shnv") pod "ef06d418-05ae-4e95-a14f-44de679566f9" (UID: "ef06d418-05ae-4e95-a14f-44de679566f9"). InnerVolumeSpecName "kube-api-access-8shnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:53:59.926512 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.926481    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef06d418-05ae-4e95-a14f-44de679566f9" containerID="caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07" exitCode=0
Sep 10 19:53:59.926659 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.926533    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"
Sep 10 19:53:59.926659 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.926581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb" event={"ID":"ef06d418-05ae-4e95-a14f-44de679566f9","Type":"ContainerDied","Data":"caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07"}
Sep 10 19:53:59.926659 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.926637    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb" event={"ID":"ef06d418-05ae-4e95-a14f-44de679566f9","Type":"ContainerDied","Data":"f150172059a5e3929cf01e880c783c20ebc40a833a36407c382fe863a0cb1e1e"}
Sep 10 19:53:59.926835 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.926669    2558 scope.go:117] "RemoveContainer" containerID="caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07"
Sep 10 19:53:59.937446 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.937425    2558 scope.go:117] "RemoveContainer" containerID="caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07"
Sep 10 19:53:59.937730 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:53:59.937707    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07\": container with ID starting with caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07 not found: ID does not exist" containerID="caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07"
Sep 10 19:53:59.937784 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.937743    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07"} err="failed to get container status \"caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07\": rpc error: code = NotFound desc = could not find container \"caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07\": container with ID starting with caa27c3ca104790966095b7df894786372a3fcb6b6916973d92e1fbd5e292e07 not found: ID does not exist"
Sep 10 19:53:59.950124 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.950096    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"]
Sep 10 19:53:59.953918 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.953896    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-blpzb"]
Sep 10 19:53:59.993566 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.993488    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef06d418-05ae-4e95-a14f-44de679566f9-extensions-socket-volume\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:53:59.993566 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:53:59.993518    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8shnv\" (UniqueName: \"kubernetes.io/projected/ef06d418-05ae-4e95-a14f-44de679566f9-kube-api-access-8shnv\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:54:01.655562 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:54:01.655527    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef06d418-05ae-4e95-a14f-44de679566f9" path="/var/lib/kubelet/pods/ef06d418-05ae-4e95-a14f-44de679566f9/volumes"
Sep 10 19:55:00.176974 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.176937    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"]
Sep 10 19:55:00.177453 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.177303    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef06d418-05ae-4e95-a14f-44de679566f9" containerName="manager"
Sep 10 19:55:00.177453 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.177314    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef06d418-05ae-4e95-a14f-44de679566f9" containerName="manager"
Sep 10 19:55:00.177453 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.177407    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef06d418-05ae-4e95-a14f-44de679566f9" containerName="manager"
Sep 10 19:55:00.180285 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.180270    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.182529 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.182508    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pldb6\""
Sep 10 19:55:00.195527 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.195508    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"]
Sep 10 19:55:00.336218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.336179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qt6x\" (UniqueName: \"kubernetes.io/projected/dcbcfd13-b28d-4924-8239-429abd119cbc-kube-api-access-8qt6x\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xwsf\" (UID: \"dcbcfd13-b28d-4924-8239-429abd119cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.336218 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.336225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcbcfd13-b28d-4924-8239-429abd119cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xwsf\" (UID: \"dcbcfd13-b28d-4924-8239-429abd119cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.437635 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.437556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qt6x\" (UniqueName: \"kubernetes.io/projected/dcbcfd13-b28d-4924-8239-429abd119cbc-kube-api-access-8qt6x\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xwsf\" (UID: \"dcbcfd13-b28d-4924-8239-429abd119cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.437635 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.437595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcbcfd13-b28d-4924-8239-429abd119cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xwsf\" (UID: \"dcbcfd13-b28d-4924-8239-429abd119cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.437981 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.437962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcbcfd13-b28d-4924-8239-429abd119cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xwsf\" (UID: \"dcbcfd13-b28d-4924-8239-429abd119cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.446459 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.446431    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qt6x\" (UniqueName: \"kubernetes.io/projected/dcbcfd13-b28d-4924-8239-429abd119cbc-kube-api-access-8qt6x\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6xwsf\" (UID: \"dcbcfd13-b28d-4924-8239-429abd119cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.490301 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.490264    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:00.769728 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:00.769697    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"]
Sep 10 19:55:00.771149 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:55:00.771124    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbcfd13_b28d_4924_8239_429abd119cbc.slice/crio-7e0b777c312214c9faed0d59dbd1e2431868b814f65be01fc33d6b336cc6fae3 WatchSource:0}: Error finding container 7e0b777c312214c9faed0d59dbd1e2431868b814f65be01fc33d6b336cc6fae3: Status 404 returned error can't find the container with id 7e0b777c312214c9faed0d59dbd1e2431868b814f65be01fc33d6b336cc6fae3
Sep 10 19:55:01.264117 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:01.264076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf" event={"ID":"dcbcfd13-b28d-4924-8239-429abd119cbc","Type":"ContainerStarted","Data":"5ae6ffacd558a82a5104f00d452bbc8cf2c52532a3c705f0c02774dc5a5086b9"}
Sep 10 19:55:01.264557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:01.264174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf" event={"ID":"dcbcfd13-b28d-4924-8239-429abd119cbc","Type":"ContainerStarted","Data":"7e0b777c312214c9faed0d59dbd1e2431868b814f65be01fc33d6b336cc6fae3"}
Sep 10 19:55:01.264557 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:01.264210    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:55:01.284152 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:01.284106    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf" podStartSLOduration=1.284088229 podStartE2EDuration="1.284088229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:55:01.282560163 +0000 UTC m=+2090.099169757" watchObservedRunningTime="2026-09-10 19:55:01.284088229 +0000 UTC m=+2090.100697797"
Sep 10 19:55:12.272316 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:55:12.272285    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6xwsf"
Sep 10 19:56:31.975158 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:31.975069    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"]
Sep 10 19:56:31.978775 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:31.978752    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.003080 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.003049    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"]
Sep 10 19:56:32.089459 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.089415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lzln\" (UniqueName: \"kubernetes.io/projected/599e6f0e-2426-4128-af62-a0e8af191f9d-kube-api-access-9lzln\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.089663 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.089606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/599e6f0e-2426-4128-af62-a0e8af191f9d-maas-api-tls\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.089663 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.089650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/599e6f0e-2426-4128-af62-a0e8af191f9d-openshift-service-ca\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.089780 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.089719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/599e6f0e-2426-4128-af62-a0e8af191f9d-metrics-certs\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.190787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.190752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lzln\" (UniqueName: \"kubernetes.io/projected/599e6f0e-2426-4128-af62-a0e8af191f9d-kube-api-access-9lzln\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.190968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.190848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/599e6f0e-2426-4128-af62-a0e8af191f9d-maas-api-tls\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.190968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.190867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/599e6f0e-2426-4128-af62-a0e8af191f9d-openshift-service-ca\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.190968 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.190903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/599e6f0e-2426-4128-af62-a0e8af191f9d-metrics-certs\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.191667 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.191635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/599e6f0e-2426-4128-af62-a0e8af191f9d-openshift-service-ca\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.193474 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.193455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/599e6f0e-2426-4128-af62-a0e8af191f9d-metrics-certs\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.193639 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.193619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/599e6f0e-2426-4128-af62-a0e8af191f9d-maas-api-tls\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.199202 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.199176    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lzln\" (UniqueName: \"kubernetes.io/projected/599e6f0e-2426-4128-af62-a0e8af191f9d-kube-api-access-9lzln\") pod \"maas-api-698bfd7f85-65zt2\" (UID: \"599e6f0e-2426-4128-af62-a0e8af191f9d\") " pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.288885 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.288800    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:32.570356 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.570310    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"]
Sep 10 19:56:32.572442 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:56:32.572407    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599e6f0e_2426_4128_af62_a0e8af191f9d.slice/crio-cd710f3f9e701ab254371efad94a77d3d0fcc60ed328f65c1b1c0e2e95798b55 WatchSource:0}: Error finding container cd710f3f9e701ab254371efad94a77d3d0fcc60ed328f65c1b1c0e2e95798b55: Status 404 returned error can't find the container with id cd710f3f9e701ab254371efad94a77d3d0fcc60ed328f65c1b1c0e2e95798b55
Sep 10 19:56:32.772384 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:32.772347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2" event={"ID":"599e6f0e-2426-4128-af62-a0e8af191f9d","Type":"ContainerStarted","Data":"cd710f3f9e701ab254371efad94a77d3d0fcc60ed328f65c1b1c0e2e95798b55"}
Sep 10 19:56:33.779181 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:33.779141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2" event={"ID":"599e6f0e-2426-4128-af62-a0e8af191f9d","Type":"ContainerStarted","Data":"f73974105ca335347e53be11fa72a3079e18d488fae55e46499ca4211367dfc4"}
Sep 10 19:56:33.779597 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:33.779208    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:33.797644 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:33.797595    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2" podStartSLOduration=2.3492544029999998 podStartE2EDuration="2.797577638s" totalImagesPullingTime="448.323235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 19:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:56:33.796307033 +0000 UTC m=+2182.612916624" watchObservedRunningTime="2026-09-10 19:56:33.797577638 +0000 UTC m=+2182.614187202"
Sep 10 19:56:39.791840 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:39.791809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-698bfd7f85-65zt2"
Sep 10 19:56:49.422907 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:49.422868    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"]
Sep 10 19:56:49.423333 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:49.423138    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x" podUID="ec43f88d-862d-437e-bd2d-feebe237e4f9" containerName="maas-api" containerID="cri-o://6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376" gracePeriod=30
Sep 10 19:56:50.670762 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.670736    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:56:50.761820 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.761719    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43f88d-862d-437e-bd2d-feebe237e4f9-openshift-service-ca\") pod \"ec43f88d-862d-437e-bd2d-feebe237e4f9\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") "
Sep 10 19:56:50.761820 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.761784    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2fv2\" (UniqueName: \"kubernetes.io/projected/ec43f88d-862d-437e-bd2d-feebe237e4f9-kube-api-access-h2fv2\") pod \"ec43f88d-862d-437e-bd2d-feebe237e4f9\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") "
Sep 10 19:56:50.762061 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.761839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-metrics-certs\") pod \"ec43f88d-862d-437e-bd2d-feebe237e4f9\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") "
Sep 10 19:56:50.762061 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.761943    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-maas-api-tls\") pod \"ec43f88d-862d-437e-bd2d-feebe237e4f9\" (UID: \"ec43f88d-862d-437e-bd2d-feebe237e4f9\") "
Sep 10 19:56:50.762165 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.762119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec43f88d-862d-437e-bd2d-feebe237e4f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec43f88d-862d-437e-bd2d-feebe237e4f9" (UID: "ec43f88d-862d-437e-bd2d-feebe237e4f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 19:56:50.762854 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.762814    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec43f88d-862d-437e-bd2d-feebe237e4f9-openshift-service-ca\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:56:50.764009 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.763979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec43f88d-862d-437e-bd2d-feebe237e4f9-kube-api-access-h2fv2" (OuterVolumeSpecName: "kube-api-access-h2fv2") pod "ec43f88d-862d-437e-bd2d-feebe237e4f9" (UID: "ec43f88d-862d-437e-bd2d-feebe237e4f9"). InnerVolumeSpecName "kube-api-access-h2fv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 19:56:50.764009 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.764003    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ec43f88d-862d-437e-bd2d-feebe237e4f9" (UID: "ec43f88d-862d-437e-bd2d-feebe237e4f9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:56:50.764171 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.764151    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec43f88d-862d-437e-bd2d-feebe237e4f9" (UID: "ec43f88d-862d-437e-bd2d-feebe237e4f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 19:56:50.863411 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.863357    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-maas-api-tls\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:56:50.863411 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.863408    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2fv2\" (UniqueName: \"kubernetes.io/projected/ec43f88d-862d-437e-bd2d-feebe237e4f9-kube-api-access-h2fv2\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:56:50.863411 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.863419    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec43f88d-862d-437e-bd2d-feebe237e4f9-metrics-certs\") on node \"ip-10-0-132-149.ec2.internal\" DevicePath \"\""
Sep 10 19:56:50.878100 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.878064    2558 generic.go:356] "Generic (PLEG): container finished" podID="ec43f88d-862d-437e-bd2d-feebe237e4f9" containerID="6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376" exitCode=0
Sep 10 19:56:50.878253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.878109    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"
Sep 10 19:56:50.878253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.878154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x" event={"ID":"ec43f88d-862d-437e-bd2d-feebe237e4f9","Type":"ContainerDied","Data":"6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376"}
Sep 10 19:56:50.878253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.878218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x" event={"ID":"ec43f88d-862d-437e-bd2d-feebe237e4f9","Type":"ContainerDied","Data":"f6a73d434f510400c5a8b09191da863cd5d8c5eb5721ae39d7545789570d5a5d"}
Sep 10 19:56:50.878253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.878247    2558 scope.go:117] "RemoveContainer" containerID="6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376"
Sep 10 19:56:50.888237 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.888221    2558 scope.go:117] "RemoveContainer" containerID="6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376"
Sep 10 19:56:50.888572 ip-10-0-132-149 kubenswrapper[2558]: E0910 19:56:50.888554    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376\": container with ID starting with 6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376 not found: ID does not exist" containerID="6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376"
Sep 10 19:56:50.888629 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.888579    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376"} err="failed to get container status \"6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376\": rpc error: code = NotFound desc = could not find container \"6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376\": container with ID starting with 6498e3d77f4f597482322a0ec03abc0c47a3f4e34fe4c0f4a04bf28fea9f7376 not found: ID does not exist"
Sep 10 19:56:50.902955 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.902930    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"]
Sep 10 19:56:50.906433 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:50.906411    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-54b46465b9-qjj5x"]
Sep 10 19:56:51.656242 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:56:51.656206    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec43f88d-862d-437e-bd2d-feebe237e4f9" path="/var/lib/kubelet/pods/ec43f88d-862d-437e-bd2d-feebe237e4f9/volumes"
Sep 10 19:57:08.075964 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:08.075932    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79fcf5569f-7sp94_9b40ebb5-a668-4170-909e-7bddd2d92154/manager/0.log"
Sep 10 19:57:08.322742 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:08.322712    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qmg2w_657e27db-6f13-4e82-b46b-50f90846c81c/manager/0.log"
Sep 10 19:57:08.444979 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:08.444952    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcddd787-cnlmb_a47bf8d5-79a6-4552-887e-793d64a1ba99/copy-manifests/0.log"
Sep 10 19:57:08.457328 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:08.457300    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcddd787-cnlmb_a47bf8d5-79a6-4552-887e-793d64a1ba99/manager/0.log"
Sep 10 19:57:09.067089 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:09.067059    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-698bfd7f85-65zt2_599e6f0e-2426-4128-af62-a0e8af191f9d/maas-api/0.log"
Sep 10 19:57:09.414153 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:09.414054    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hmblr_e1f8bd21-3771-4145-8d34-870f7e947e68/postgres/0.log"
Sep 10 19:57:10.359602 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:10.359573    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-8ft9z_d30f7ed4-8d40-46ed-94a1-8e29f0711ac5/manager/0.log"
Sep 10 19:57:10.487855 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:10.487805    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-htpjk_80db617f-d4df-44ea-957d-7037fe66f837/manager/0.log"
Sep 10 19:57:10.741783 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:10.741748    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6xwsf_dcbcfd13-b28d-4924-8239-429abd119cbc/manager/0.log"
Sep 10 19:57:11.530338 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:11.530292    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8nkm_43d6a214-30fd-4836-88bb-c443c5da6135/discovery/0.log"
Sep 10 19:57:11.650289 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:11.650259    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf7f4d9c5-5dqd9_8ecde841-dbdf-44d4-bec8-27d21092be6b/kube-auth-proxy/0.log"
Sep 10 19:57:12.143407 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:12.143363    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s46mh_256a7d14-aadc-43bd-b457-dc318fc6b539/payload-processing/0.log"
Sep 10 19:57:12.636792 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:12.636761    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-n2wpr_7f278e9a-bcaf-4b95-8804-36f3a8e6c748/main/0.log"
Sep 10 19:57:12.883825 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:12.883796    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-f8dvn_cfc6905e-4b59-41a8-bdf8-dfb1575ac01a/main/0.log"
Sep 10 19:57:22.167795 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:22.167765    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kwds8_d73d1992-e3e8-46c7-9a80-ee3a2fb672ea/global-pull-secret-syncer/0.log"
Sep 10 19:57:22.329019 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:22.328985    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xfvmr_8153f3b3-cd4d-4ac4-b808-5fadb4937044/konnectivity-agent/0.log"
Sep 10 19:57:22.351325 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:22.351303    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-149.ec2.internal_c3c9811dd99e57f23a5e3fa521a13acb/haproxy/0.log"
Sep 10 19:57:27.431368 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:27.431333    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-8ft9z_d30f7ed4-8d40-46ed-94a1-8e29f0711ac5/manager/0.log"
Sep 10 19:57:27.474084 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:27.474052    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-htpjk_80db617f-d4df-44ea-957d-7037fe66f837/manager/0.log"
Sep 10 19:57:27.580060 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:27.580027    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6xwsf_dcbcfd13-b28d-4924-8239-429abd119cbc/manager/0.log"
Sep 10 19:57:29.203635 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.203607    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_839f399b-0935-4738-bffd-55db87770d61/alertmanager/0.log"
Sep 10 19:57:29.245205 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.245176    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_839f399b-0935-4738-bffd-55db87770d61/config-reloader/0.log"
Sep 10 19:57:29.302041 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.302007    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_839f399b-0935-4738-bffd-55db87770d61/kube-rbac-proxy-web/0.log"
Sep 10 19:57:29.335534 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.335509    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_839f399b-0935-4738-bffd-55db87770d61/kube-rbac-proxy/0.log"
Sep 10 19:57:29.381548 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.381519    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_839f399b-0935-4738-bffd-55db87770d61/kube-rbac-proxy-metric/0.log"
Sep 10 19:57:29.416571 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.416541    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_839f399b-0935-4738-bffd-55db87770d61/prom-label-proxy/0.log"
Sep 10 19:57:29.448654 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.448629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_839f399b-0935-4738-bffd-55db87770d61/init-config-reloader/0.log"
Sep 10 19:57:29.579675 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.579604    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-hfkn4_e9448b03-7fd6-4e30-9035-8cb7f43e475f/kube-state-metrics/0.log"
Sep 10 19:57:29.635651 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.635623    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-hfkn4_e9448b03-7fd6-4e30-9035-8cb7f43e475f/kube-rbac-proxy-main/0.log"
Sep 10 19:57:29.708397 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.708355    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-hfkn4_e9448b03-7fd6-4e30-9035-8cb7f43e475f/kube-rbac-proxy-self/0.log"
Sep 10 19:57:29.757896 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.757872    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-95f56ccd-7zksc_0881fa70-ae08-414e-90dc-8cee994c69bb/metrics-server/0.log"
Sep 10 19:57:29.857926 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.857835    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fc84z_9483c9a1-3e07-48eb-b8ff-48a0d090fc59/node-exporter/0.log"
Sep 10 19:57:29.901815 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.901784    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fc84z_9483c9a1-3e07-48eb-b8ff-48a0d090fc59/kube-rbac-proxy/0.log"
Sep 10 19:57:29.956199 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:29.956170    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fc84z_9483c9a1-3e07-48eb-b8ff-48a0d090fc59/init-textfile/0.log"
Sep 10 19:57:30.999395 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:30.999338    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-5qdzh_2bc595cd-c8e6-47d3-9735-3d83421b3ad8/prometheus-operator-admission-webhook/0.log"
Sep 10 19:57:31.042206 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:31.042179    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677bf9775c-psfkp_beb44d42-f042-4a98-a4b5-60688d2430e9/telemeter-client/0.log"
Sep 10 19:57:31.079886 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:31.079858    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677bf9775c-psfkp_beb44d42-f042-4a98-a4b5-60688d2430e9/reload/0.log"
Sep 10 19:57:31.111920 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:31.111832    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677bf9775c-psfkp_beb44d42-f042-4a98-a4b5-60688d2430e9/kube-rbac-proxy/0.log"
Sep 10 19:57:32.423829 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.423778    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"]
Sep 10 19:57:32.424226 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.424212    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec43f88d-862d-437e-bd2d-feebe237e4f9" containerName="maas-api"
Sep 10 19:57:32.424273 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.424227    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec43f88d-862d-437e-bd2d-feebe237e4f9" containerName="maas-api"
Sep 10 19:57:32.424305 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.424288    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec43f88d-862d-437e-bd2d-feebe237e4f9" containerName="maas-api"
Sep 10 19:57:32.427448 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.427431    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.431512 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.431491    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lkczj\"/\"kube-root-ca.crt\""
Sep 10 19:57:32.431770 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.431757    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lkczj\"/\"default-dockercfg-rr7jr\""
Sep 10 19:57:32.431825 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.431805    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lkczj\"/\"openshift-service-ca.crt\""
Sep 10 19:57:32.441495 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.441472    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"]
Sep 10 19:57:32.531527 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.531494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-proc\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.531527 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.531532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-sys\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.531751 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.531553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd9gm\" (UniqueName: \"kubernetes.io/projected/2cd12b82-a837-449f-b949-9761d80e4e95-kube-api-access-cd9gm\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.531751 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.531676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-lib-modules\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.531751 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.531707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-podres\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.632973 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.632935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-lib-modules\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.632973 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.632977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-podres\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.633197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.633102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-podres\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.633197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.633100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-proc\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.633197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.633138    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-proc\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.633197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.633146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-sys\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.633197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.633109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-lib-modules\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.633197 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.633179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd9gm\" (UniqueName: \"kubernetes.io/projected/2cd12b82-a837-449f-b949-9761d80e4e95-kube-api-access-cd9gm\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.633447 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.633200    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd12b82-a837-449f-b949-9761d80e4e95-sys\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.642598 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.642570    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd9gm\" (UniqueName: \"kubernetes.io/projected/2cd12b82-a837-449f-b949-9761d80e4e95-kube-api-access-cd9gm\") pod \"perf-node-gather-daemonset-8d9p8\" (UID: \"2cd12b82-a837-449f-b949-9761d80e4e95\") " pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:32.736859 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:32.736825    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:33.010752 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:33.010718    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"]
Sep 10 19:57:33.012779 ip-10-0-132-149 kubenswrapper[2558]: W0910 19:57:33.012747    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2cd12b82_a837_449f_b949_9761d80e4e95.slice/crio-f0fb5858bc6ed357052488cc02f54a4303b5c46865e8d33d9dcfa08f07dec42b WatchSource:0}: Error finding container f0fb5858bc6ed357052488cc02f54a4303b5c46865e8d33d9dcfa08f07dec42b: Status 404 returned error can't find the container with id f0fb5858bc6ed357052488cc02f54a4303b5c46865e8d33d9dcfa08f07dec42b
Sep 10 19:57:33.119923 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:33.119891    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8" event={"ID":"2cd12b82-a837-449f-b949-9761d80e4e95","Type":"ContainerStarted","Data":"f0fb5858bc6ed357052488cc02f54a4303b5c46865e8d33d9dcfa08f07dec42b"}
Sep 10 19:57:34.113849 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:34.113776    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-mcf7h_b30c88a5-d90d-4b16-98a9-c673fabda0d6/download-server/0.log"
Sep 10 19:57:34.127130 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:34.127098    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8" event={"ID":"2cd12b82-a837-449f-b949-9761d80e4e95","Type":"ContainerStarted","Data":"57a504bfc22b029a4cbe3eebe11fdcdbdf48ed605f7af1bc3cb2f4eb3fea7f48"}
Sep 10 19:57:34.127291 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:34.127243    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:34.156896 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:34.153395    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8" podStartSLOduration=2.153355785 podStartE2EDuration="2.153355785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 19:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 19:57:34.148680242 +0000 UTC m=+2242.965289828" watchObservedRunningTime="2026-09-10 19:57:34.153355785 +0000 UTC m=+2242.969965354"
Sep 10 19:57:36.117801 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:36.117768    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzfcj_82334143-4b6f-45c1-b80d-ca73b4c5b33a/dns/0.log"
Sep 10 19:57:36.146588 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:36.146554    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzfcj_82334143-4b6f-45c1-b80d-ca73b4c5b33a/kube-rbac-proxy/0.log"
Sep 10 19:57:36.197200 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:36.197171    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9ctcv_b0bfcc8d-58a9-408d-ad9c-afc9c437964e/dns-node-resolver/0.log"
Sep 10 19:57:36.808590 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:36.808560    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-595d9c976d-jht75_58085a60-fe26-40c7-9901-100acd34c1d6/registry/0.log"
Sep 10 19:57:36.856116 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:36.856089    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-29wfz_57ccd984-a453-4cd9-976d-fc0baf29af98/node-ca/0.log"
Sep 10 19:57:38.283031 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:38.283000    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8nkm_43d6a214-30fd-4836-88bb-c443c5da6135/discovery/0.log"
Sep 10 19:57:38.305787 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:38.305761    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf7f4d9c5-5dqd9_8ecde841-dbdf-44d4-bec8-27d21092be6b/kube-auth-proxy/0.log"
Sep 10 19:57:38.448145 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:38.448116    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s46mh_256a7d14-aadc-43bd-b457-dc318fc6b539/payload-processing/0.log"
Sep 10 19:57:39.369087 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:39.369060    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-65jm6_72cdca30-8f4c-417a-80b8-0dc950d6d3c2/serve-healthcheck-canary/0.log"
Sep 10 19:57:40.142942 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:40.142906    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lkczj/perf-node-gather-daemonset-8d9p8"
Sep 10 19:57:40.166935 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:40.166906    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wcwp8_472a8d76-7aa4-4028-a3bd-e343b9c0c633/kube-rbac-proxy/0.log"
Sep 10 19:57:40.195831 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:40.195800    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wcwp8_472a8d76-7aa4-4028-a3bd-e343b9c0c633/exporter/0.log"
Sep 10 19:57:40.219973 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:40.219939    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wcwp8_472a8d76-7aa4-4028-a3bd-e343b9c0c633/extractor/0.log"
Sep 10 19:57:42.914993 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:42.914964    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79fcf5569f-7sp94_9b40ebb5-a668-4170-909e-7bddd2d92154/manager/0.log"
Sep 10 19:57:43.050838 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:43.050808    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qmg2w_657e27db-6f13-4e82-b46b-50f90846c81c/manager/0.log"
Sep 10 19:57:43.124620 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:43.124538    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcddd787-cnlmb_a47bf8d5-79a6-4552-887e-793d64a1ba99/manager/0.log"
Sep 10 19:57:43.148253 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:43.148230    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcddd787-cnlmb_a47bf8d5-79a6-4552-887e-793d64a1ba99/copy-manifests/0.log"
Sep 10 19:57:44.142628 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:44.142544    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8nkm_43d6a214-30fd-4836-88bb-c443c5da6135/discovery/0.log"
Sep 10 19:57:44.173943 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:44.173917    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf7f4d9c5-5dqd9_8ecde841-dbdf-44d4-bec8-27d21092be6b/kube-auth-proxy/0.log"
Sep 10 19:57:44.274600 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:44.274569    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s46mh_256a7d14-aadc-43bd-b457-dc318fc6b539/payload-processing/0.log"
Sep 10 19:57:46.073679 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:46.073644    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8nkm_43d6a214-30fd-4836-88bb-c443c5da6135/discovery/0.log"
Sep 10 19:57:46.099016 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:46.098991    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf7f4d9c5-5dqd9_8ecde841-dbdf-44d4-bec8-27d21092be6b/kube-auth-proxy/0.log"
Sep 10 19:57:46.204874 ip-10-0-132-149 kubenswrapper[2558]: I0910 19:57:46.204827    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s46mh_256a7d14-aadc-43bd-b457-dc318fc6b539/payload-processing/0.log"